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ABSTRACT 


Blum's machine-independent treatment of the complexity of partial 
recursive functions is extended to relative algorithms (as represented 
by Turing machines with oracles). We prove relativizations of several 
results of Blum complexity theory, such as the compression theorem. A 
recursive relatedness theorem is proved, showing that any two relative 
complexity measures are related by a fixed recursive function. This 
theorem allows us to obtain proofs of results for all measures from proofs 
for a particular measure. 


We study complexity-determined reducibilities, the parallel notion 
to complexity classes for the relativized case. Truth-table and primitive 
recursive reducibilities are reducibilities of this type, while other 
commonly-studied reducibilities are not. 


We formalize the concept of a set helping the computation of func- 
tion (by causing a saving in resource when used as an oracle in the 
computation of the function). Basic properties of the "helping" relation 
are proved, including non-transitivity and bounds on the amount of help 
certain sets can provide. 


Several independence results (results about sets that don't help each 
other's computation) are proved; they are subrecursive analogs to degrees~ 
of-unsolvability theorems, with similar proofs using diagonalization and 
priority arguments. In particular, we discuss the existence of a 
“universally-helped set," obtaining partial results in both directions. 
The deepest result is a finite-injury priority argument (without an 
apparent recursive bound on the number of injuries) which produces sets 
preserving an arbitrary lower bound on the complexity of a set. 


Our methods of proof include proof for a simple measure (e.g. space) 
and appeal to recursive relatedness, diagonalization and priority techniques, 
and heavy use of arguments about the domain of convergence of partial 
recursive functions in order to define total recursive functions. 
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1. Introduction 


Blum [Bl] introduces an axiomatic framework for discussing the 
complexity of partial recursive functions of integer variables. In 
this thesis, we use a parallel approach for the case of relative 
algorithms (i.e. partial recursive functions of one integer and one set 
variable, as represented by Turing machines with oracles [D] [Rol]). 
Our extension of Blum's ideas allows us to discuss axiomatically 
several problems impossible to formulate from the original set of 


axioms. 


For example, we can formalize the idea that one function helps 
the computation of a second function; we can also give some meaning to 


"the complexity of a nonrecursive function." 


The axioms we give include as special cases the "natural" measures 
on relative computations, namely the time and space measures on oracle 
Turing machines. Thus, the axiomatic statements of our various 
theorems are also true when interpreted for the specific measures. If 
we were to state and prove our theorems directly for the time and 
space measure, the results would be more precise and the proofs more 
intuitive. However, the axiomatic proofs are much shorter and cleaner; 
therefore, our general policy in this thesis is to state and prove 
results axiomatically, giving intuitive remarks about time and space 


wherever possible. 


In Chapter 2, we present our axioms for relative complexity and 
prove some basic results suggested by theorems of non-relativized 


complexity theory. 
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The first important result is that any two measures satisfying 
the axioms are recursively related; the proof is by Konig's lemma. 
This theorem is important primarily because it provides an alternative 
method of proof of general-measure theorems. Certain types of theorems 
may be proved easily for a particular measure (usually space) and then 
the recursive relatedness between space and other measures can give 


the general result. We employ this method occasionally. 


We note that the standard results of complexity theory, such as 
speed-up, compression and gap theorems [HH] all have full relativiza- 
tions with proofs exactly like the usual proofs. Several partial 
relativizations are also true; we prove some which are of interest or 
will be of later use. In particular, we prove a relativization of 
the combining lemma [HH], which states that the complexity of a compu- 
tation is closely related to the complexity of its subcomputations. 
This will imply some later results; it is the first example of our use 
of a method of proof which we call the ''domain-of-convergence" method, 


and which is used in axiomatic proofs throughout the thesis. 


In Chapters 3-6, we study questions natural to treatment within 


relative complexity theory. 


A notion which parallels that of a complexity class [McC] [McCMe] 
in the relativized theory is that of a "complexity-determined reduci- 


bility," which we study in Chapter 3. 


To any class C of functions corresponds: 
(A,B) |A is computable from B within measure equal to some function in (}. 


For certain classes C, this provides a reasonable reducibility. 
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Truth-table reducibility [Rol] and the relation "primitive recursive 
in" [IK] are examples of reducibilities of this type, while other 


commonly-studied reducibilities such as many-one and one-one reduci- 


bilities [Rol] are not. 


We show that neither truth-table reducibility nor primitive 
recursive reducibility can be completely specified by a single bound 
function (i.e. a singleton class ay However, each may be so specified 
on any countable class of oracle sets, as we show by a relativization 
of the Meyer-McCreight union theorem [McC] !McCMe]. For example, 
there is a function t such that: 

(A s,, B © A is computable from B within measure t) 


tt 


for all arithmetical sets A and B. 


By selecting special classes of functions — we may define 
new complexity-determined reducibilities; for example, by letting: 
C = {A-recursive functions} 
for some set A, we define a reducibility somewhere between truth-table 
and Turing reducibility, which weseall "A-reducibility."' By 


considering all sets A, we arrive at a hierarchy of reducibilities. 


A relativization of the compression theorem shows that: 
(VA,B)!(A-reducibility = B-reducibility) ° (A-recursive functions 


and B-recursive functions are the ''same size") ]. 


This fact reduces questions about the reducibility hierarchy to 
purely recursion-theoretic questions; we prove several results about 
this hierarchy, for example, that there exist Turing-incomparable 


sets determining the same reducibility. 
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In Chapter 4, we try to establish a formalism within which to 


discuss questions such as the following: 


(1) Which sets make the computation of a function easier than it 


would be without the help of these sets? 


(2) How much help (increase in speed) does an oracle for some 


set provide in a computation? 


We propose several possible definitions of "helping," each of 
which provides a reasonable way of discussing the concept. Briefly, 
we define helping of the computation of a function on either an infinite 
set of arguments or on "almost all" arguments. We also discuss helping 
in the sense of lowering the complexity of a function below a given 


lower bound function. 


We then present a series of basic results which can be formalized 
using the definitions. First, we show that any set whose complexity 
is small cannot give much help to the computation of any function. We 
then show that any recursive set has arbitrarily complex recursive 
sets (with their complexity closely determined) that do help its 


computation. 


As done by Trachtenbrot ("autoreducible sets") [Tl], we formalize 
the idea of a set helping its own computation, by having values of 
its characteristic function at different arguments strongly inter- 
dependent. We then present a result of Paterson [P] proving the 
existence of such sets, of complexity approximately equal to any given 


monotone running time. 
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Independence results (theorems that state that certain sets do 


t help the computation of certain recursive functions) are analogous 
to theorems about functions having a certain lower bound on their 
complexity; diagonalization is the only tool we have for proving. them. 


We prove a version of the following statement: 


"There exist pairs of complex recursive sets that don't 


help each other's computation." 


We use a diagonalization method in the proof, based on work by Meyer, 
M.J. Fischer and Trachtenbrot; priorities are used. We first construct 
a set with no interdependence between the values of its characteristic 
function at different arguments. We then split this set into two 


pieces and argue that neither piece can help the other's computation. 


This result illustrates proof techniques which will be used ina 
more complicated fashion in Chapter 6. It has several interesting 
corollaries, including the fact that "helping" is not a transitive 


relation. 


Since the independent sets are constructed by a diagonalization, 
it is difficult to understand much about them. A more interesting 
result would arise if we could arbitrarily fix one of the sets. 


Thus, in Chapters 5 and 6, we ask the following question: 
Which is true? 


(1) There is a recursive set A whose computation is helped 
by all sufficiently complex recursive sets B (a "universally- 


helped set"), or 
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(2) For all recursive sets A, there exist arbitrarily 


complex recursive sets B that don't help the computation of A. 


We obtain some partial results in both directions, using different 


interpretations of "helping." 


In Chapter 5, we produce the strongest results we can to obtain 
the first answer. We note that the complexity axioms are sufficiently 
general to be satisfied by various "pathological" measures; specifically, 
that any recursive set will be a "universally-helped set" in some 
relative complexity measure. From here on, we use a mechanism for 


eliminating such trivial cases. 


We go on, in theorem 5.2, to construct sets which are not 
“universally-helped,' but which are "almost universally-helped," in 
the sense that they are helped by all recursive sets whose complexity 
is "nicely determined."' More specifically, for any recursive function 
h, we obtain a recursive set AL such that the computation of A, 's 
characteristic function is helped on infinitely many arguments by any 
recursive set whose complexity is (to within accuracy h) equal to a 
running time. This is the strongest result we have obtained in the 


direction of answer (1). 


In Chapter 6, we work in the opposite direction, beginning with 
a recursive set A and constructing sets B not helping A's computation. 
As before, we use diagonalization and priority techniques in obtaining 


our results. There are two major results in the chapter. 


The first theorem, theorem 6.2, states the following: 


il 
If we have a recursive set A and a recursive function ty 
with the property that every Turing machine computing A's characteristic 
function requires more than th space on an infinite set of arguments, 
then there are arbitrarily complex recursive sets B such that every 


B-oracle Turing machine computing A's characteristic function still 


requires more than ty space on an infinite set of arguments. 


The proof idea is due to Machtey [Mal] and involves a diagonali- 


zation with simple priorities. 


The second theorem, theorem 6.3, states that, provided we 
restrict our attention to functions ty which are running times, we 
have a similar result to theorem 6.2 for a different type of lower 
bound the Namely, if we have a recursive set A and a total running 
time ty with the property that every Turing machine computing A's 


characteristic function requires more than t, space on almost all 


A 
arguments, then there are arbitrarily complex recursive sets B such 
that every B-oracle Turing machine computing A's characteristic 


function still requires more than t, space on almost all arguments. 


A 


This theorem is the deepest result in the thesis. The 
diagonalization required is considerably more complicated than that 
required for theorem 6.2, and involves a finite-injury priority 
argument in which there is no apparent recursive bound on the number 


of times a requirement may be injured. 


The independence results serve to demonstrate that there exist 
arbitrarily complex pairs of recursive sets which are recursive for 


"different reasons." 
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There is, of course, no conflict between the results of Chapters 


5 and 6, as we show. 


Open problems are interspersed throughout the thesis as they 
arise, and are collected in Chapter 7. Also, in Chapter 7, we present 
additional open problems and directions for further research. One 
particular direction mentioned is that studied by Symes in [Sy], 
where he considers helping not only by oracle sets, but also by 
partial functions. In general, we would like to formalize other 
notions of "helping,'' specifically those which represent the way in 
which a subroutine "helps" the computation of a function computed 


by a computer program. 
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2. Notation, Axioms and Basic Results 


We assume familiarity with the notation used by Rogers [Rol]. 


We use "(Vx)" and "a.e. (x)" to mean "for all but a finite 
number of x.'"' When no confusion is likely, we simply write "a.e." 


("almost everywhere"). 


Similarly, (Bey or "i.o. (x)" means "for infinitely many x," 


and we write "i.o." to mean "infinitely often." 


We write "a sp" to mean a-pb ifa2b 


{| 0 ifa<b. 


The composition "go t" where t is a function of one variable 


and g is a function of two variables, will indicate Ax/g(x,t(x))]. 


rR represents the set of total recursive functions of n integer 


variables. 


ng Ade represents the set of total A-recursive functions of n 


integer variables. 


ew represents the set of partial recursive functions of n 


integer variables. 


np An represents the set of partial A-recursive functions of n 


integer variables. 


We write "Tt" for divergence and "UY for convergence of compu- 


tations. 
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"[k]" represents the integer part of k. 


For any i, A, if 0, Mast, we use the convention that 


A 
», | ) (x) =o, By convention, © < », and n<© for any n €N. 


The notions of "relative algorithm" and of an enumeration of 
relative algorithms @, ' ), are amply described in [Rol, 39.2]. 


Specifically, we use the following: 


Definition 2.1: A sequence @,‘ , of relative algorithms is called 


Nacceptable" if: 
(1) (», ‘ ), includes all relative algorithms 
(2) Universal Property: 
iy ¢ 6) Ctx.) 1 <i>) =9,% C0] 
(3) s-m-n Property: 


(WH © 0,0} Gs ERA) egy Ow = 1 <t,—>)1. 
We discover by methods analogous to those used in [Ro2] that: 


A 
Lemma 2.2: Let @, ' ), and @, § )y be any two acceptable 
orderings of relative algorithms. Then there exists a recursive . 
isomorphism r such that: 


CHD Rea =o," 1, 


Lemma 2.2 will make our theory independent of the particular 
formalism chosen. We will generally refer to the development in 
[Rol] or to the notion of an oracle Turing machine when precision 


is required. 


We now define a "relative complexity measure." 
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Definition 2.3: A relative complexity measure a) is a collection of 


partial functions from N to N, ae one for each (i,A), satisfying 
the following two conditions: 
(1) (¥i,A) [domain 9, = domain 7) 


(2) There exists y! a a relative algorithm, such that: 


c if 3% x =y 


(Vi,x,y,A) y (<i,x,y>) = . 
[0 otherwise 


(9) 


We abbreviate 9, as o.- The functions g, 


are often referred to informally as "running times."' There is no 


(), 


is an acceptable Godel numbering for the partial recursive functions 


confusion here with the usual Gédel numbering notation, as (P, 


[Ro2]. 


A note on our choice of axioms: axiom (1) is surely reasonable, 
but it may be thought that axiom (2) is stronger than we ought to 
assume. However, both axioms are satisfied by all natural measures 
on relative computations (i.e. time and space on oracle Turing machines). 
Aliso, axiom (2) is plausible in that it merely requires the 


existence of a single "unified description" of any measure. 


Thus, for the time measure, axiom (1). says that a computation 
takes a finite amount of time if and only if it converges, and axiom 
(2) says that we can effectively tell if a computation halts in a 
given number of steps. For the space measure, axiom (1) says that 
a computation uses a finite number of tape squares if and only if 
it converges, while axiom (2) says that we can effectively tell if a 


computation halts without exceeding a given amount of workspace. 
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Later in the chapter, we verify that these axioms hold for time and 


space measures. 


These axioms are extremely simple, and similar to Blum's axioms 
for partial recursive functions [Bl]. We will see in the following 


chapters that they are quite powerful. 


We refer to [Sy, Chapter 3] for some interesting results using 
these axioms. In particular, we shall use the fact that 6) (x) is 
a partial recursive function of x, uniformly in A and i. That is: 


(a) (YAsisx) (9, (<i) = 3, % G1. 


In spite of the theory's independence of the particular 
formalization of relative algorithm, enumeration and measure, it is 
desirable to keep in mind the natural measures (time and space on 
oracle Turing machines). The particular oracle Turing machine model 


we will use is as follows: 


Each Turing machine has four semi-infinite tapes: an input tape, 
an output tape, an oracle tape and a worktape. The first three are 
marked in binary, with the exception that the input tape has a marker 
to indicate the end of the input. The worktape has k possible symbols, 
for some number k which depends on the machine. We assume for 
definiteness that the input and output heads cannot move left. Also, 
the machine cannot write on its input tape or read from its output 
tape. There are otherwise no restrictions on the operation of the 


machine, other than the usual Turing machine constraints [Rol]. 


This Turing machine is designed to be used in conjunction with an 
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"oracle" for any set. (An X-oracle is an unspecified agent having 


information about set X.) This is done as follows: 


In addition to its other states, the Turing machine may have a 
state called "INTERROGATE." When the machine enters this state, it 
asks the oracle whether the number currently written on the oracle 
tape is a member of the oracle set. The oracle gives its answer by 
causing the machine to enter either of two different states. The 
oracle tape is then automatically erased, the oracle tape head reset 


to the first tape square, and the computation is allowed to continue, 


Each oracle Turing machine may be described by a flowchart or 
some other finite description. The machine's description is inde- 
pendent of the particular oracle set used, so the same oracle machine 
may be used with any oracle. The finite descriptions may be 
enumerated in a natural way. We identify 9,‘ ) with the a machine 
description in this enumeration; our enumeration is "acceptable," 


and so there is no notational inconsistency with usage in [Rol]. 


We now define two measures on this machine model: 


xo) 


, time measure 


For any i, x, A, we define 7, (x) to be the total number of steps 
executed in the computation 9, (x). Here, each oracle interrogation 


counts as a single step. 


It is clear that the axioms for relative complexity are satisfied; 


for instance, to discover if 1, @) = y, y Cia, y>) must construct 


() 


the machine Ps then simulate 0, (x) for y steps to see if it 
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converges. 


5 6 - space measure 


For any i, x, A, we define 3) (x) to be the maximum of the 
number of worktape squares visited and the number of oracle tape 
eas : : (A) (A) 
squares visited during the computation o. (x), provided that 0, (x)!. 


Otherwise, we let 5. (x) = @, 


Axiom (1) is satisfied by definition. To see that axiom (2) is 
also satisfied, we note that for any i, x, y and A, if 0, (x) 
operates for (4) (27) Cy) (27) (y) Clog x) steps without exceeding space 
y, it must be in an infinite loop and hence will not converge. This 
bound arises since if the machine is ever twice in the same state, with 
the same worktape contents, the same worktape head position, the same 
oracle tape contents, the same oracle tape head position and the same 
input tape head position, it must be in an infinite loop. The six 


factors in the above expression represent bounds on the number of 


different possibilities for each of the six items. 


Thus, to see if gS Ga) = y, we need only simulate 0, (x) for 


(1) (1%) Cy) (27) Cy) Clog x) steps to see if it converges. 


We note that our machine model has linear speed-up [HLS] for 


machines that don't use their oracle tapes. That is, given any ¢ > 0 


() CY ag 


and any such machine o, ; we can effectively find °. 


(A) (A) 


that for all sets A, ¢€° S; 2 ot a.e. 


We also note that the space measure has the following property, 


sometimes called the "parallel computation property": [LR] 
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There exists a recursive function 7 such that for all i and j, 


9, (x) if S, (x) < S , (x) 
M1, 4) 


©, (x) otherwise 


and Sai, 4) © = min(S, (x) ,S (x)). 


This property, which essentially allows us to re-use the same 
tape squares for different portions of a computation, often makes it 
very easy to prove theorems for the space measure. It also causes 
some results for space measure to be sharper than those for other 


measures. We will point out such cases where they occur. 


Theorems concerning the complexity of partial recursive functions 
[B1] [HH] [McC] all have straightforward full relativizations with 
proofs parallel to the original proofs. For example, from Blum's 


speed-up theorem [B1] we obtain: 


Proposition 2.4: (relativized speed-up theorem) 
cvay(va e Ry (ae ¢ R,, £ 0-1 valued) (Vi) 
(co, = f) = (a3), =f A s(x,8,) () < 3%) cx) a.e.)]. 
(That is, for every program for f using an A-oracle, there is 


an a.e. much faster program also using an A-oracle.)_ 


The proof is exactly like the usual proof of the speed-up theorem, 
using a relativization of the recursion theorem in place of the 


recursion theorem itself. 


More interesting and useful are partial relativizations of the 


results on complexity of partial recursive functions, Following are 
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several examples. 


Our first theorem asserts that any two relative complexity mea- 
sures are related by a fixed recursive function. Its usefulness 
lies in enabling us to draw conclusions about one relative measure 
from hypotheses about another relative measure, as we do in some of 


the results following the theorem. 


Theorem 2.5: (recursive relatedness) 

Tf 36 ) and sx ) are two relative complexity measures on the 
same acceptable Godel numbering fe, 6 4, then there exists r ¢ R, 
such that: 


(vai) 14, < ro $4) ae] 


and (VA,i) 8, 4) sro 3 ae]. 


Proof: We require a lemma which is a direct consequence of Konig's 
lemma ("Endlichkeitslemma," [Rol,Ex. 9-40]) and which will be used 


in several later theorems as well. 


Lemma 2.5.1: Suppose we have a recursive function f of k integer 
variables and one set variable. Suppose that f is total. 

Suppose finally that (VX) 962+ 2%) [£" (xy 5-06 s%,) = ee £(x)5+++s%,2A)]. 
Then f£' ¢ Re 

Proof of lemma 2.5.1: The computation of £* (xy 50++9%) may be carried 


out as follows: 


Generate a "computation tree" for the function F(x) +++s%,5A) as 


A ranges over all subsets of N. Each branch of the tree must terminate, 
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since £ (xy 90209, 2A) converges for all sets A. Therefore, the entire 


tree is finite and we will eventually finish generating it. We can 
then take the maximum of the outputs on all branches as the value of 


£" (x1 5-0+s%,)- 


Proof of theorem 2.5, continued: By symmetry, it suffices to obtain 


re R, satisfying the first inequality. 


We define r(x,y) = max p(i,x,y), where 


isx 
p(i,x,y) = max p'(i,x,y,A), and 
nN 
May it ROW = y 
p'(i,x,y,A) = > 


‘0 otherwise. 


p' is a total recirsive function of three integer variables and 


Thus, rv eR,. 


one set variable. Therefore, by lemma 2.5.1, p eR 2 


3° 
To see that r has the required properties, we consider a par- 


ticular A and i. 


A 
If 8) (x) diverges, the inequality holds by convention. 


If 8S) (x) converges and x 2 i, then: 
(x,8, Gey) > picts, 8, Gey, a) 
> 3M), as required. 


QED 


Remark 2.5.2: The recursive isomorphism between any two acceptable 
enumerations of relative algorithms (lemma 2.2) allows us to conc lude 
the recursive relatedness of relative complexity measures on two 


different enumerations. Specifically, we obtain: 
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A 
WIE we,‘ ), and @, ' dy are any two acceptable enumerations of 
A 
relative algorithms, with relative complexity measures a ( ) and 3 ( ) 
respectively, then there exists a recursive isomorphism f and a 
function r ¢€ Ry such that: 
‘ A) (A) 
¥ 3 3 
(YA,i) [ i sro £(i) a.e. | 


and (VA,i) aa Sro q a.e.]." 


The proof is a simple modification of the proof of theorem 2.5, 


using the recursive isomorphism whose existence is given by lemma 2.2. 


Theorem 2.5 and remark 2.5.2 provide an alternate method to 
general axiomatic proof for certain types of theorems about relative 
complexity measures, The method is to prove the theorem for one 
specific measure, and then apply theorem 2.5 (or remark 2.5.2) to 
obtain the result for all measures. We will use this new proof 
method in some cases; as an example of its use, we give the following 


corollary to theorem 2.5 and remark 2.5.2. 


The result has two parts; in part (1) we see that (just as in the 
non-relativized case) there exist arbitrarily complex functions. 
However, in contrast to the non-relativized case, part (2) shows 
that inherently complex functions cannot be 0-1 valued. In fact, 


their complexity must result from the size of the function values. 
First, a definition: 


Definition 2.6: Assume B is a set, f €& Ry and g is a total function 


of one variable. 


23 
! (B) 2 WwW 
Comp £>g 1.0. (ave.) _means 


, (i) mM =£ = 8, >g 4.0. (ae). 
"Comp '®) ¢ < gn 7 means 
@i) p,™ = 2 a 3, <g). 
"comp ®) ¢ < g i.o. (a.e.)" means 
(44) pr, =f A qe g i.o. (a.e.)]. 
"Comp f > g i.o." means . 


Comp) 


f£>g i.o., and similarly for the 
other abbreviations, | 
If £ = C, for some set A, we may write "Comp A" in place of 


"Comp f."' 
We are now ready to state and prove the corollary: | 


Corollary 2.5.3: Let a ) be any relative complexity measure. Then: 
(1) (V£, £ total) (Gg, g total) (VA) 

[Comp g>f a.e.]. 

(2) (Wh, h total)(@f, £ total)(Vg, g total) 


le <sha.e.) * (8A)(Compg < £ ace.)). 


Proof: (1) Let r be the function obtained by aspigtte theorem 2.5 
to @ ( ) and 7‘ ), We may assume without loss of generality that r is 
monotone nondecreasing in its second variable. 
Given f, let g(x) = gt (*,£(x)) om 
169, = g, then clearly Cae) 2, © (xe > r(x,£(x))], since it 
requires r(x,f(x)) + 1 steps merely to output the result in binary. 
But (x8, (x) 2 1) a.e., by theorem 2.5. 
Thus, r(x,8,) (xy) > r(x,£(x)) ae. 


5 Ow > f(x) a.e., as required. 
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If the relative complexity measure 3 ) is on an enumeration 
of relative algorithms other than oracle Turing machines, we apply 


remark 2.5.2 in place of theorem 2.5 and obtain the same result. 


(2) Let r be the function obtained by applying theorem 2.5 to 
3 ( ) and 5 ) again chosen to be monotone nondecreasing in its 
second variable. 

Assume h is given. 

F 2 2 

Define f(x) = r(x,x + h (x)). 

Now consider any g with g <h a.e. 

Let A = {<x,g(x)>|x ¢ N}. 


It is straightforward to design a machine | ) such that 


(A) 2 


Q. 


j = g and for which Sy) sx + are a.e. For instance, 


. (A) : : 
the machine %; on argument x can operate by successively computing 


<x,0>, <x,1l>, <x,2>,..., and asking if each is in A. If so, the 


machine terminates with the appropriate output. 


2 
The bound “A +h (x) results from the particular form of the 
pairing function used [Rol, $5.3). 
But then oe < rexs8, © @)) a.e., by theorem 2.5. 


< see + AGA) a.e. 


f(x). 


So a Go < f(x) a.e., as required. 


As in (1), if the relative complexity measure 3 ( ) is on an 
enumeration of relative algorithms other than oracle Turing machines, 
we apply remark 2.5.2 in place of theorem 2.5 and obtain the same 


result. 


QED 
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Informally, corollary 2.5.2 shows that (1) functions must be 
as complex as their size, and (2) given the proper oracle, a function 


need be no more complex than its size. 


Henceforth, whenever we use this new method of proof, we will 
appeal to "recursive relatedness"; it will be understood that we 
intend this to mean we are applying theorem 2.5 or remark 2.5.2, 
whichever is appropriate, in a fashion similar to that used in the 


proof of corollary 2.5.3. 


The non-relativized compression theorem [Bl] asserts the 
existence of a recursive "compression function" h such that whenever 
we are given any total running time go, we can obtain a 0-1 valued 
function not computable in measure < Q., but computable in 


measure < ho e.. 


Lemma 2.7 is a relativization of this result; it asserts the 
existence of a recursive “compression function" h such that whenever 
we are given any total function g, we can obtain an oracle set B and 
a 0-1 valued function not computable from a B-oracle in measure g, 


but computable in measure ho g. 


This lemma will later be used to prove theorem 3.6. 


Lemma 2.7: Assume we are given a relative complexity measure g ( Mi 
Then (4h e€ R,) (Vg, g total) (4B,A) 
(1) Comp ‘B) 4 > g i.o. 


and (2) Cony A sho g. 


Proof: Given g, we define B = {<x,g(x)>|x € NY. 
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Define: 


- (B) (B) 
Stasis 1 Pry (x) (x) if $ m4 8) (x) = g(x), 
0 otherwise 


A is thus defined from B by a diagonalization which insures that 


the first condition is satisfied. To verify the second condition, 
we must define h. 


First, define a relative algorithm ©, ‘ ) as follows: 


18% (x) ee) 4e (lz) [<x,2> €X] and 
a2 cade) S uz(<x,z> € Xj], 
(¥x,X) 9,” Qs 0 near) [<x,2> €X] and 
8) (X) (x) > uzl<x,z> € X], 
© otherwise. 


(A note on this definition: the existence of the relative 
algorithm 4 given by axiom (2) of definition 2.3 immediately implies 


that the tests for inequality may be made effectively in x and X.) 


Now define h(x,y) = max h'(x,y,X), where 
XSN 


[2,% ew if <x,y> € X, 
h'(x,y,X) = ¢ 7 
l 0 otherwise. 
h' is total recursive in x, y and X, since: 
<x,y> €X * ow! 
= 6, Mont, by axiom (1). 


Therefore, h € R,, by lemma 2.5.1. 


2? 


For the particular g, A and B under consideration, we compare 
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the definition of Cy with the definition of @ | ) and conclude that 
(B) _ 


Also, since <x,g(x)> € B for all x, it follows that: 
h(x,g(x)) 2 h'(x,g(x),B) . 
= 1) for all x, as required. 


QED 


Remark: We note that the proof of lemma 2,7 actually provides a 
result considerably stronger than that stated. Namely, 
"(Why ¢ R,) (Gh, € R,)(Vg, g total) (¥B) (3A) 


(B) 


[Comp*“g < hyo ga.e. > (1) Comp ‘Pa >g i.o., and 


(2) Compa < h,o g a.e.]." 


To prove this result, we can either modify the given proof of lemma 
2.7, or note that the result holds for space measure and use recursive 


relatedness. 


The condition "Comp ©) 


gs hy o g ae." is an example of an 
"honesty condition" - one which specifies that a function has a 
running time which is approximately equal to its size. Honest 


functions (a generalization of running times, as we will later show) 


are extensively studied in [MeMo}. 


Honesty conditions will turn out to be necessary hypotheses 
for many of our later theorems, particularly in chapters 5 and 6. 
There, for simplicity, we will usually require that a function be a 
running time, whereas a less restrictive honesty hypothesis would 


have been sufficient. 
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In lemma 2.7, the first conclusion may be sharpened to assert 
that Comp A > g a.e., rather than merely i.o. This is done by 


introducing two additional tricks into the construction. 


The first is a sharper form of diagonalization in the construction 
of A which makes g an a.e. lower bound on A's complexity. The basic 


construction is due to Rabin and may be found in [HH]. 


Rabin's method defines C, at successively larger values of x, in 


A 
order. Thus, computing Cy (x) for any x requires first computing 

g(0), g(1),..-, g(x). In order to keep the complexity of A as small 
as possible, we introduce the second modification, due to Blum: we 


compute C, on arguments not in order of size of the arguments, but 


A 


in order of size of the values of g. 


Since both of these ideas will be used in the succeeding chapters, 


we give the detailed construction: 


Theorem 2.8: Assume we are given a relative complexity measure  ( a 
Then: 

(dh € R,) (Vg, g total and g = Ax!x]) (HB,A) 

(1) Comp ‘Ba > eg a.e., 


and (2) Comp ‘Ba Sho g 


Proof: Given g, we define B as before. 


C) 


We define a relative algorithm y as follows: 


(X) 


will be defined in stages; thus, to compute 


(X) 


For any X, y 


a? until 


(x), we begin executing stages in the definition of y 
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_ the value of y™ (x) becomes defined. At each stage, at most one 


additional integer is added to the domain of qs 


During the construction, an index i will become "cancelled" 


when we have insured that y™ ¥ °°? ‘ 


Stage n in the definition of y™: 


Find the smallest integer y for which there exists an integer 
x S y such that y™ cx) was not defined at an earlier stage and 


<x,y> ¢ X, and for this y the smallest x. 


(It is possible that this search may not terminate, in which 
case yo will diverge at all arguments for which it has not already 


been defined.) 


When <x,y> has been found, we find the smallest uncancelled 


i <= x such that #, © (x) Sy. 
If no such i exists, define y™ (x) = 0. 
If 1 does exist, define y™) (x) = 1+, (x) and camel 1. 


In either case, go on to stage n+ 1. 
END OF CONSTRUCTION 
Verification: We let A be a set such that y® = Ca: (This is 


possible since y) is 0-1 valued and total.) 
We claim Comp‘) 4 > g a.e, 


For if not, then for some i, yaa = Cy and = g i.o. 
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But after some stage n in the construction of yh = Cas all the 
indices smaller than i which ever get cancelled have already been 
cancelled. But for some x such that C, (x) is defined after stage n, 
6 P(x) < g(x), 


so that we will define: 


C, (x) =]: 0 Pm, a contradiction. 


ey) C) 


To verify the second conclusion, we choose j such that ?; = ¥ 
define h and proceed exactly as in the proof of lemma 2.7. 


QED 


Remark: As for lemma 2.7, the property of B that we actually require 
in this theorem is that B makes the function g honest (i.e. g can be 
computed from a B-oracle within measure approximately equal to g). 


We can thus obtain the more general result: 


"(Vh, €R,)(Gh, € R,)(V¥g, g total and > Ax[x]) (VB) (day 
(comps Ss hy oga.e. > (1) Comp (8) 4 > g a.e., and 


(2) Comp” a < hy o g a.e,]" 


A formal proof of this remark uses techniques we have not yet 
developed, namely a method of proof we will call the "domain-of- 
convergence method." In Chapters 4 through 6 we will discover 
ourselves repeatedly using this type of method to prove theorems. 

A restricted form of the idea of domain-of-convergence arguments 
may be stated in the form of a lemma, a relativization of the 
combining lemma [HH]. The statement of ‘ lemma sufficiently general 
to imply all the later results is necessarily cumbersome; we will 


therefore present it in something less than its full generality. 


ae 
In the form of lemma 2.9 below, the relativized combining 


_ lemma implies some of the later results (corollary 2.9.1, lemma 4.7, 
lemma 6.2.1). Several others (theorems 4.8, 6.3) will use essen- 


tially similar methods. 


The lemma relates the complexity of a computation to the 
complexity of its subcomputations. As in [Rol, 35.6], we let Dy 


represent the finite set with canonical index k. 


Lemma 2.9: (combining lemma) 


Assume we are given a relative complexity measure 3 ) and a 


function c € R et such that: 


2 
(Wiss. sxe ot ed1 29 2%,A) 


(lo, Pain. ey oot nes soon 


A) xy ay]. 


eS 2G 
Pe(Li sere sts) 059) 


Then there exists g € Ry such that for all A, 


g(x,max{ §, ae Co rrcee A) (x) , 8 a ACOSD 
1 


1 ‘m J 
(4) (x) 


8 | a.e. (x). 
Slinger asip 

' Proof: 

Note: This proof is still valid if j and k are eliminated, or it c is 


also a function of additional parameters which don't affect the 


convergence implication. 


Define g(x,y) = max 8'(xs¥5t)4+++ oka edy oda)s 
i, Sx for k<m, 4,5*, j,*x 


where g'(x,ys1)5+--4)55, 24) = are een ca and 
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| (A), 
PoC iui dny tre ee er 
m?~1?-2 (A) 
: [é, s yl, 
k . 


and 
-(D 
J, 


s"(x,y,4)5- oe st od 055.4) = 


$ 35) (x) sy 


0 otherwise. 


It is easily seen that g" is total recursive in.m-+ 4 integer 
variables and 1 set variable. Therefore, by lemma 2.5.1, g' € R_,,, 


so that g € Ro. 


To see that g has the desired properties, we note that if 
x 2 max (ij se++s4 54,240), then: 


sor max(ty (2),...48 MP o,8) M4 Go1) * 


(D 


| Gamat hy OG) 5008p G58) 4) GOI sty reees 


195424224) 


(A) 
e 
CL) yee sh 55) 04q) (x), as required 


QED 


As a simple example of the use of lemma 2.9, we give the following 
‘corollary... The result, a relativization.of the compression theorem, 
is closely related.to lemma.2.7. Here, however, we fix the oracle 


(B) 


set B in advance and work with B<recursive functions Pos whereas 
in lemma 2.7 we work with any total function g and find a set which 


makes g honest. 


Honesty is relevant for this corollary as well. We begin with 


33° 
any Berecursive function 9, °?, but we only ‘obtain a set A with 
complexity approximately equal.to 4 Ba B-honest function) rather 


than rae 


Corollary 2.9.1: Assume we are given a relative complexity measure 3 d 
Then (dh € R,) (WB) (Vi, a” total)(HA) such that: 


(B) (B) 


Comp * “A > 9, Lio. 


and Comp 3) 4 Sho +0) a.@. 


Proof: We define a relative algorithm ys ) as follows: 


For all 1, x, B, 


Lig. se) if 9, ()s and 
1 
vy) (ets) = bye) Qe), 
0 if 9, B) (x)4 and 
(B) (B) 
at (x) (x) > P, (x), 


1£ 9, Pent. 


By the relativized s-m-n theorem, there exists c € Ry such that 


y® (<i x>) = iy 
Now it is clear that (Wt, ,x,B) (9, (x4 > tag ole 
We may now apply lemma 2.9 and assert that: 


(BD (4) a.e.]. 


(Bh € RW, B)InGe, 8, D) = By 


We now fix i and B as in the hypotheses, and let Cy = aa 


This is possible since the hypotheses imply that Bay is 0-1 


valued and total. 
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By the diagonal construction defining it, Cy satisfies the 
first conclusion; the second conclusion follows from (*). 


~ QED 


Many of the interesting partial relativizations of the speed-up 
theorem [Bl] may be expressed in terms of "helping"; we discuss in 
these terms the amount by which possession of ‘an oracle speeds up the 
computation of a function. This type of question forms the subject 


matter of Chapters 4, 5 and 6. 


A relativization of the unton theorem [McC] will be given in 


Chapter 3, together with some interesting consequences. 
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3. Complexity-Determined Reducibilities 


Just as we study complexity classes within non-relativized 
complexity theory [McC] [McCMe], we may consider resource-bounded 
relative computation. A fixed resource bound defines a kind of 


"reducibility" as follows: 
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Definition 3.1: For any relative complexity measure » any sets 


A and B, and any total function f of one variable, 

"AS, B ca! dyn means Comp ‘34 < f a.e., where complexity 

is measured in 3 2 

More generally, if ec is any class of total functions of one. 
variable, 

"A <e B ca! dyn means (Sf €C)[A <, B «36 dy] 

_ We read this notation as "A is f-reducible to B" and "A is 

C-reducible to B," respectively. When no confusion is likely, we 


omit mention of the measure we are using, and write simply "A <- B" 


and "A ae B." 


Several commonly-studied reducibilities usually defined via 
"natural" (i.e. non-complexity-theoretic) restrictions on the method 
of computation may be expressed as C-reducibilities for appropriate 
choices of the class (, and thus may be regarded as complexity- 
determined. In particular, truth-table reducibility [Rol] and the 
relation "primitive recursive in" are complexity-determined 


reducibilities, while many-one and one-one reducibilities are not. 


We first consider primitive recursive reducibility. We write 


"A = B" to indicate that A is primitive recursive in B, and "f se B" 
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to indicate that f is primitive recursive in B [K]. 


2 * : . 
Theorem 3.2: Let C= {primitive recursive functions of one 


variable}. Then (VA,B)[A =a B @ A <0 B cr! 54 


Proof: We use the type of T-predicate used by Davis [D], modified 


slightly for our Turing machine model. 


As in [D], we see that: 


(VB) [hz ,x,y[T?(z,x,y)] is primitive recursive in B]. 


An examination of the encoding used in the T-predicate shows 
that there exists f, a primitive recursive function of three variables, 
such that: 


(WByw,x,y,2)0(0, P(x) sx) = By S F(z x,w) T(z x,y) 1]. 


(That is, some code number for the computation is effectively bounded 
by a function of the number of steps in the computation, the input and 


the index of the machine.) 


We now define, for every set B, a function 8p of three variables 


as follows: (Notation is from [K].) 


| uwy < f(2,x,w)IT(z,x,y)]) if y exists 
By (ZsXsW) = < 
L 0 otherwise 


(Intuitively, 8p (Z»x,W) represents the output of the computation 


3) CEs. provided a 


(x) Sw.) 


Sp is obviously primitive recursive in B, for any set B. 


Now assume we have sets A, B with A <3 B. This implies: 
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(di, Gh a primitive recursive function of one variable) 


=9,%) A x(t, = h(@11. 


Then the definition of Bp shows that Cy = Axfg, (isx,h(x)) 1, and 
the function on the right-hand side of this equation is primitive 


recursive in B. 
Thus, A<pB > As, 5. 
The converse is proved using the following lemma: 


Lemma 3.2.1: (WB) (V£)[(f£ = B) * (dp, a primitive recursive function) 
Ip 2 f]]. 
(That is, any function primitive recursive in any set is no larger than 


some primitive recursive function. ) 


Proof of lemma 3.2.1: We carry out a straightforward proof by induction 


on the definition of the class of functions primitive recursive in Be 


In particular, Cy < Ax!1], which is primitive recursive. The 


other base functions for the induction are themselves primitive recursive. 


The two induction steps (composition and recursion) follow without 
difficulty if we note that; 
(Vf, primitive recursive) (df', primitive recursive) 


[(£' = £) A (£' is monotone increasing in each of its variables) ] 
For example, we verify the recursion step: 


Assume that h is a function of k + 1 variables with h =p B. 


Assume that g is a function of k - 1 variables with g a B. 
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Assume h S PL and g < Pye where Py and Py are each primitive 


recursive and monotone increasing in each variable. 


Assume a function f is defined by primitive recursion from g and h: 


(We write "x" to indicate "Xqoee0s%") 
£(0,x) = g(x) 
(Vy) £(yt1,x) = hy, f(y,x),%) 
Now define Pp 48 follows: 
Pe(0,x) = p(x) 
(¥y)  pe(yt],x) =p, (ysp,(y,x) »x) 


It is easy to verify that Pe is primitive recursive and f < Pe» 


as required. 


Proof of theorem 3.2, contimed: 


We again use induction on the class of functions primitive recursive 


in B. 


An oracle Turing machine with a B-oracle can obviously compute 
C, rapidly. In particular, 
(Hi) (Gp, a primitive recursive funetion) [@, > =C,) A an, =< p)]. 


The other base functions are primitive recursive, and so are 


computable in primitive recursive time. [C] 


The two induction steps are straightforward; we verify the 


primitive recursion step, leaving the composition step to the reader: 
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Assume we have f, g and h as in the proof of lemma 3.2.1. As 


inductive hypothesis, we assume: 
B 
@i)1@, =) A (, 


and (89) 1@, =) A c2,® < BLD) 


=) < Py) r 


where Py and Ph are primitive recursive and monotone increasing in 


each variable. 


By lemma 3.2.1, there exists f', a primitive recursive function 


such that f =< f', 


We define a primitive recursive function Pp a8 follows: 
pe(0,x) = p(x) 
(¥y)  pe(ytl,x) = pp(y.x) + py (ysf"(y.x) 5x) 
We claim that the primitive recursive function p, + x, dase X, +y 


is an upper bound for the time required to compute f. If further details 


on this induction step are desired, see [C], [Al], [RD], [RRW] or [MeRD]. 
Corollary 3.2.2: Theorem 3.2 is true for 5 ) in place of r! ue 


Proof: 5 ) and 1! ) are related, in the sense of theorem 2.5, by a 
primitive recursive function, as we can show by an argument similar to 


the looping argument in the discussion of 3 ) in Chapter 2. 
Remark: Theorem 3.2 is false for some pathological measures. 


We now consider truth<table reducibility [Rol]. A result of 
McLaughlin [McL] combined with theorem 2.5, gives the following 


complexity~determination result for truth-table reducibility: 
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Proposition 3.3: Fix any relative complexity measure, 
tet C = R,- Then: 


(VA,B) [ASB @ A S¢ BJ. 


On the other hand, many-one and one-one reducibilities are not 
determined _ a complexity restriction, eee relative san Tene 
measure. The reason is that there are pairs of sets computable from 
each other in a very small amount of resource but which are not many- 
one reducibie to each other (for example, any nonrecursive recursively 
enumerable set and its complement) . Thus, for natural measures, it is 
obvious that many-one and one-one reducibilities are not complexity- 


determined. For general measures, however, a little work is required: 


Proposition 3.4: Fix any relative complexity measure. Let ( be any 
class of total functions of one variable. Then it cannot be the case 
that: 


(VA,B € R,) [A <3 A S@B}. 


Proof: Assume the contrary: let C determine many-one reducibility 


36), 


for measure 


By consideration of r' ) and remark 2.5.2, we see that: 


(K) _ (K) 
(ds € R,) 4H) 1@, = Cc.) A (2, <s)]. 
But K 4 K, so that (Vc ¢ C ) te(x) < s(x) i.o.]. 


To obtain a contradiction, it suffices to show that: 
A,B) I(A SB) A (comp), > 5 a.e.)] 


But this follows from the following lemma: 
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Lemma 3.4.1: Fix any relative complexity measure. Then: 


(Vs ¢€ R,) (VB recursive) (4A recursive) 


rcomp “4: > 5 ase. Js - 


Proof of lemma 3.4.1: We note that is, def ae 
8 def é (B) 

i i 
satisfy the requirements for an acceptable Godel numbering and a Blum 


complexity measure. 


Then the existence of arbitrarily complex (a.e.) recursive sets 
in any Blum measure [B1] gives us a set A such that: 
, = $ > 


A 
which translates into the desired result by the definitions of ®, and . 


Proof of proposition 3.4, continued: 


Now select any infinite, coinfinite recursive set B, and use 
lemma 3.4.1 to obtain an appropriate set A. We can easily obtain A 


infinite and coinfinite, and so A =, B. But Comp‘), >s a.e., giving 


1 
the desired result. 

QED 
Corollary 3.4.2: Proposition 3.4 is true for one-one reducibility in 


place of many-one reducibility. 


Proof: Implicit in the proof above. 


Open Question: Is it true that: 
(Vs ¢€ R,) (WB infinite and coinfinite) (GA ™ B) 


[comp‘®)4 > 8 ace.) ? 
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Having shown that primitive recursive and truth-table reduci- 
bilities are complexity-determined, we ask if it is possible to ex- 
press them even more succinctly; for instance, is it possible to 
characterize each by a single resource bound function rather than a class 


of functions? 


This question immediately suggests that we would like an analog 


to the union theorem [McC], and so we prove the following: 


Theorem 3.5: (relativized union theorem) 
Assume we have a sequence of total functions {t.}, with: 
Vi > 
( i,n)![t,.,(m t,(n)]. 
Let T be a set such that Ai,n't,(n)] is recursive inT. 
Also assume that we have a sequence (B,} of sets, and a set B 
such that: Mi, nC, (n)] is recursive in B. 
= (B join T) 
1 


Then there exists a function f ER such that: 


(¥i,5)18,) s face.) © GEG, 7) < t, ae.)]. 


k 
(This means that for any Baa the class of functions computable 
with oracle ae within measure f is exactly the union of the classes of 


functions computable with oracle 8, within measure t the union being 


k? 


taken over all ty) 


Proof: The construction of f is carried out in stages, with f(n) 


being defined at stage n. 


We define an auxiliary function g(i,j), whose values may be changed 


at successive stages. The significance of g(i,j) is as follows: 


We "guess" that 6B) (x) st (x) a.e. 


(isi) 
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Stage n: (Define f£(n).) 


For all (i,j) such that i + j = n, define g(i,j) = n. 


Let E = {(i,j)/i +4 <n ae 6) (m) > NONE 
Define: . t (a) ifE=¢ 
f(n) = ae ed 3) ™ otherwise. 
oJ , 


For all (i,j) € E, redefine g(i,j) =n. 
Go on to stage n+ 1. 


END OF CONSTRUCTION 
Verification: 


Assume we have i, j, k and we know that 6) s t. a.e. We would 
like to conclude that a Gy S f a.e.; it therefore suffices to show 


that (Vk) ft, Sf a.e.]. 


If not, then for some k we have f(n) < t,, (a) on infinitely many 


arguments n> k. 


At stage k, there can only be finitely many pairs (i,j) with 
e(i,j) <k. We let F be this finite set of pairs. After stage k, 
no pair (i,j) ever has g(i,j) become defined to be less than k. There- 


fore, if g(i,j) <k at some stage after stage k, we know that (i,j) © F. 


Now if f(n) < t, (nm) on infinitely many arguments n> k, then for 
these n, f(n) is defined to equal t,/, y@ for some (i,j) € F with 


g(i,j) <k. But then at stage n, g(i,j) is redefined to equal n. 
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Since F is a finite set, this can only occur finitely often 


before no pairs (i,j) remain with g(i,j) <k. 


Therefore, we have (Vi,}) 


(ak) (8, a rae (a, Py) < f a.e.)] 


Conversely, assume we have (i,j) with (We) 18, Fp > te i.o.]. 
Then each time we define g(i,j), we will subsequently reach a stage n 
where: 


B,) 
EG 


At this stage n, (i,j) will be in set E, so the definition of 
f will insure that 6) (n) > £(n). We iti also redefine g(i,j). 
But it is easy to see that this must happen for infinitely many 
arguments n, so that; 


a By) > £ Lo. 


Thus, we have: 


(Wi, 9) 1%) 8, Fp >t, io.) 2 @,F) > £ to]. 


k 


It is clear that f is recursive in B join T. 


QED 


We now apply theorem 3.5 to the cases of truth-table reducibility 


and primitive recursive reducibility. 


Corollary 3.5.1: Consider any countable collection of sets (B,} with 


a join K) 


B as.in:theorem 3.5. There exists f ¢ -such that: 


(Vi,A)P AS, By AS, By]. 


Proof: We define a sequence {t,} as follows: 
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Let t, (x) aie ©, ~@lP ws for all y = x} if this set is 
jSi 
nonempty 


0 , otherwise 


These t, have the properties required for theorem 3.5, with 


T = K. 


Also, (Vr € R,) (49) [r <t, a.e.] 


j 
(Vj) (@r ¢ R)[t, Sr a.e.] 


Thus, by proposition 3.3, if Cx. {t,}, then 


(YA,B)[A SB ® A Sq BJ. 


Application of theorem 3.5 now gives the desired result. 
QED 


C) or r' ), Consider 


Corollary 3.5.2: Assume we are working with S 
any countable collection of sets {By}, with B as in theorem 3.5. There 
exists f € rR, such that: 


(Wi, A) [A s, 3, @ AS, By). 


Proof: Let {P,} be an enumeration of the primitive recursive functions 
such that Ai,x[p, (x) ] is recursive. Then define: 


t.(x) = max p. (x). 
: st 


{ty} satisfies the required properties for theorem 3.5, with 


t= g, 


Clearly, (Vi) Ip, St, a.e.], and 


1 
(Vi) (@j) ft, < P; a.e,]. 
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Applying theorems 3.2 and 3.5 gives the desired result. 
QED 
Thus, we see that for any countable collection of oracle sets 
(e.g. recursive sets, arithmetical sets), truth-table reducibility 
is determined by a single resource bound function on any measure, and 
primitive recursive reducibility is determined by a single resource 


bound function on measures 6 ) and 36 ye 


The next question we consider is whether any single function can 
determine either of these two reducibilities on all pairs of sets. 
This we show to be impossible; thus, the countability hypothesis in 


corollaries 3.5.1 and 3.5.2 cannot be eliminated. 


Theorem 3.6: There is no function f of one variable such that: 


(VA,B recursive in f)! A ne ad A oe B]. 


Proof: Assume such a function f exists. 


We claim that (Vr ¢ R,)[£>r ae]. 
For if not, then (dr ¢€ R)[r aes ae Cee Fre 


But then, by Rabin's diagonal method, there exists a recursive 
set A such that Comp A>r a.e. We have A S,) ¢, since A is recursive, 


but clearly —(A <_ @), a contradiction. 


Now consider the function h whose existence is asserted in lemma 2.7. 
We may assume without loss of generality that h is monotone increasing 


in both variables. 


Define a function g as follows: 
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max{ y|h(x,y) s £(x)} if the set is nonempty 
g(x) = 
0 otherwise 


We claim that (Vr ¢€ R,) Ig >ra.e.]. This is easily concluded 


from the facts that (Vr ¢ R,) lf >r a.e.] and that h is recursive. 


‘ 


We now apply lemma 2.7 to obtain A and B such that: 
AS B) A (A S_ B)}. 
[(A $5 BY AWA S, BD] 


But (A he B) implies (A <¢ B) since ho g = f a.e. 


“(A es B) implies -(A ve B), since g is almost everywhere 


greater than each recursive function. 


Thus, f£ does not determine truth-table reducibility on all pairs 
of sets. 


QED 


Theorem 3.7: Assume that we are working with space measure on oracle 
Turing machines. There is no function f of one variable such that: 


(VA,B) [A 5 B@? A <5 B]. 
Proof: The proof is analogous to that of theorem 3.6: 


We claim, if such an f exists, that: 


(Vr, primitive recursive in one variable) /[f > r a.e.], 


For if not, then: 
_ (ar, primitive recursive in one variable) /f = r i.o.]. We may 
assume without loss of generality that r le monotone nondecreasing. 
But then, by a Rabin diagonalization argument, there exists a recursive 


set A such that Comp A>r a.e. 


48 
However, by a result of Cobham [C] and an examination of the 
diagonalization, we see that: 
(4i) (as, primitive recursive of one variable) (p, =C, AS, <8 a.e.]. 


A i 
We thus have A a %, but “(A <, $). 


If we let 3 ( ae 3 ) in lemma 2.7, it is possible to obtain a 
function h satisfying the conditions of the lemma which is primitive 
recursive. We construct B and A as in lemma 2.7, and define g as in 


the proof of theorem 3.6. 


As before, we obtain: 


(Vr, primitive recursive in one variable)/[g > r a.e.]. 


‘Thus, as before, AS,B A (A = B). 


f 


Therefore, £ does not determine primitive recursive reducibility 
on all pairs of sets. 
QED 


Remark: An analogous proof also holds for 7S ) in place of s( , 
Open Question: Is theorem 3.7 true for all Blum measures? 


Open Question: Examine other natural reducibilities, such as bounded 
truth-table reducibility, or any of the others mentioned in [J1], to 


see if any are complexity-determined. 


We have seen that some reducibilities with "natural" definitions 
may be alternatively described by a complexity restriction. Conversely, 
it is’ possible to define new reducibilities by a complexity restriction. 


In the remainder of this chapter, we give an example of such a definition, 
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and examine some properties of the resulting reducibilities. 


Definition 3.8: For any sets A, B, C, we say "A is C-reducible to B" 
(A <o B) provided: 
Sp te) 
A <p B for C=R, . 
We write "C-reducibility" to indicate ((A,B)]A <<. B}. 


Thus, any set C determines a new reducibility, namely, the 
collection of pairs of sets computable from each other in C-recursive 
measure. The reducibilities are clearly measure-invariant, by 


theorem 2.5 and remark 2.5.2. 


Strictly speaking, anything we call a "reducibility" ought to be 
reflexive and transitive, properties which do not hold for general 
classes C. However, our C-reducibilities are reflexive and transitive: 


reflexivity is clear, for any C. We demonstrate transitivity: 


Lemma 3.9: For any sets A, B, C and D, 


Ss 
[(As,B A BS,D) = ASD]. 


(C) 


Proof: By measure invariance of C-reducibility and closure of Ry 
under finite modification, we obtain: 


@iy@e, eR, 1c, = 9, a 8, < 11, and 


; (C) =o ©) (D) 
(45) Gey © RY) IC, =o, A 8,0 Sep]. 


We describe an oracle Turing machine which computes Cy using 


a D-oracle: 


The Turing machine computes C 


A according to procedure ©, ™, but 


the values about which we query the B-oracle get written on a second 
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track of the worktape instead of the oracle tape. Then, to decide 


(D) 


their membership in B, we use ° , with our D-oracle. 


How much space is required by this new machine? 


For input x, the machine uses 6 Ge to carry out the computation 


(B) 


?; (x). In addition, the largest argument for which we might need 


cS) 


F Ss. ‘ : 
to compute C. is 277i so we might also require: 


(B) 
so), Br) eae seent (x), , 


Thus, the space needed is bounded above by the maximum of: 


(B) 
a Gs. i) ace Oe Sh, 
1 J J 
which is bounded above by the maximum of: 
c,(x) 
C4 (%) 565 (0) 5-44 5¢5(2 1 ). 


But this maximum is a function in eae 


Thus, A So D. 


QED 


We remark that results similar to theorems 3.6 and 3.7 may be 


obtained for these reducibilities as well. 


There are simple relationships between these reducibilities and 


others: 


Proposition 3.10: (a) For any set C, A ree B >? A So B > A Sp B. 


(b) If C is a recursive set, AS, B 7 A = B. 


C t 


Proof: Immediate from proposition 3.3. 
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We would like to have a structural description of C-reducibility 
as an alternative to the complexity definition. We obtain the following 


partial result in this direction: 


Remark 3.11: Assume C So B. Then (VA) 
A <o B © (df e€ R, ) rx €A © tt-condition f(x) is satisfied by B] 


(For notation, see [Rol]). 


(This says that, provided the oracle set has a sufficiently high 
degree of unsolvability, any reducibility of our type may be described 
by the ability to construct a truth table for the computation with the 


help of the appropriate oracle.) 


Proof: (=) Similar to McLaughlin's proof [McL]. The condition C <o B 


is not needed for the proof in this direction. 


(=) We assume that C < 
(B) 5 @) 
1 


B, specifically, that 


Sg where g € ee 


Cc 
Ga Re 
We assume also that: 


Ix €A © tt-condition f(x) is satisfied by B]. 


We show that C, is computable from B in C-recursive time. The 


A 


procedure we will use for computing Cy using a B-oracle is as follows: 


"Given input x, we compute f(x). f is recursive in C, so 
F j B 
we simulate a machine computing f from C; we use »,' ) to 


obtain answers to questions about membership in C. 


Once we have the truth-table f(x), we then ask the B-oracle 


about membership of each argument in the truth table and use the 
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answers to find the value of C, (x) from the truth table." 


How much time is required by this procedure? 


(C) 


If we assume that f = oe , then we can obtain f(x) in time 
approximately bounded by: C 
PP y y st ) (x) 


re Ge) + z ety), 
y=0 


(B) vy) 


since the largest value y for which we might need to compute @, 
ng 20x) 


is 2i . Clearly, this sum is bounded by a total C-recursive 


function. 


Once we have f(x), it is not difficult to show that the remaining 
time required to obtain C, (x) by asking the appropriate questions about 


membership in B is bounded by a C-recursive function. 


Thus, the total time is bounded by a C-recursive function, so 


QED 
Each set determines a reducibility. We may obtain a "hierarchy 
of reducibilities" between truth-table and Turing reducibilities, 
ordered by a comparability relation. Using a relativization of the 
compression theorem, we conclude that comparability is exactly 


determined by size of functions: 


Theorem 3.11: Assume we are given two sets, C and D. Then 


[(VA,B)IAS, B > AS, BI] ® ((VE ¢€ Re € Shape tl: 2 fa.e.)] 


Proof: ( *) Obvious. 
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(9) Assume (Gf ¢ Ry) (ie € a yt <f i.o.]. 
Then by a direct relativization of the compression theorem, 


(C) 


(4A recursive in C) (Vi) Ip, =C., = a) > f a.e.]. 


It is easy to show that AS, C but —(A Ss C), a contradiction, 


QED 


Corollary 3.11.1: For any sets C, D, 
(Cc =r D) * (Cereducibility = D-reducibility). 


In the remainder of this chapter, we ask about the converse of 
Corollary 3.11.1. That is, if sets determine the same reducibility, 


need they be Turing equivalent? In certain cases, the answer is yes: 


Definition 3.12: A set A is weakly majoreducible if there exists 
fe id such that: 


(Yg)lg = £ > A is recursive in g]. 


This definition is weaker than, although similar to, the definition 


of "majoreducible" used and studied extensively by Jockusch in [J2]. 


Theorem 3.13: If sets C and D are weakly majoreducible, then: 


(C-reducibility = D-reducibility) => (c =D) 


Proof: If C-reducibility = D-reducibility, then by theorem 3.11 and 
closure of moe under finite modification, we have: 


(ve er, @g cn, [ge €). 


By weak majoreducibility of C, C is recursive in g for the 


appropriate choice of f. 
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Therefore, C <S_ D. 


T 


Symmetrically, we have D <, C. 
QED 
Corollary 3.13.1: If sets C and D are recursively enumerable, then 


(C-reducibility = D-reducibility) © (C =r D). 


Proof: It follows immediately from work of Jockusch in [J2] that all 
recursively enumerable sets are majoreducible (his definition) and 


hence weakly majoreducible. The reason is as follows: 


Suppose C is a recursively enumerable set. If C is finite, f = 0 


satisfies definition 3.12. 


Otherwise, let (¢,} be an effective enumeration of C without 


repetitions. 


Define f(n) = uz[(Vy)(y>2z > cy >n)]. 


(C) 
1. 


It is easy to show that f ER 
If g = f, we may compute C,(n) by listing C for g(n) steps to see. 


if n turns up. Thus, C is recursive in g, so is majoreducible. 


QED 


Note: Examination of the proofs above, combined with the Friedberg- 
Muchnik theorem [Rol, 810.2] shows that there exist pairs of recursively 
enumerable sets C and D determining incomparable reducibilities; that 
is, A,B) I(A S$, B) A (AS) BD] 

and (GA,B)[(A $B) A (A S, B)]. 


We have thus shown that for a large collection of sets, if any pair 


5) 
determines the same reducibility, the two sets must be Turing equivalent. 


However, this is not true in general. In fact: 
Proposition 3.14: Given any set C, there exist two sets A and B such 


that AlB and A-reducibility = B-reducibility = C-reducibility. 
T 


We omit a detailed proof because it is quite long and not very 
different from other proofs in the literature. There is a modified 
version [Mal] of Spector's splitting-tree construction of minimal sets 
[Rol, 313.5] which produces a nonrecursive set A which is "small" rather 
than minimal: that is, 


qe er, ig e Ry) Ig = EI. 


In outline, in the proof of proposition 3.14 we simultaneously 
construct two "small" sets, A and B, by modified splitting-tree 


constructions, with two added changes: 


(1) We encode C into both sets at the beginning: of the construction. 
(2) We alternate the splitting-tree construction with a straight- 


forward diagonalization making A and B Turing incomparable. 


The resulting sets A and B are such that: 


We er, @g er, ) [ge £ ace.) since C <, A, 
and 
(V£ ¢€ Rr, ) as € ee) [Ig = £ a.e.] by the construction,. 


and similarly for B. 


Thus, by theorem 3,11, A-reducibility = B-reducibility = 
C-reducibility. 


QED 
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Open Question: Given any nonrecursive set A, is it always possible to 


find a set B such that A|B but A-reducibility = B-reducibility? 
T 


Open Question: What are necessary and sufficient conditions on sets 


A and B for A-reducibility to equal B-reducibility? 


Although pairs of sets can have the same reducibility and still be 
Turing-incomparable, there do exist limits on what Turing~reducibility 
relationships sets can have and still determine the same reducibility. 


For example: 


Proposition 3.15: If C-reducibility = D-reducibility, then we cannot 


to< 
have C T D. 


Proof: Assume C' Sr D. 


( 


Let g(n) = max @,m| OSisn a o, Oy eS}: 


g eR, 7, sog eR 
But clearly (Vf ¢€ Rye te > £ i.o.]. 


So by theorem 3.11, C-reducibility # D-reducibility. 


QED 


Open Question: In [J1], Jockusch develops the properties of various 
types of truth-table reducibilities, e.g. containment properties of 
degrees. Explore the answers to these questions for C-reducibilities 
for various sets C. For example, does C-reducibility have any 


properties significantly different from truth-table reducibility? 
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4. Helping 


Intuitively, we have the idea that some sets B help to compute 
some functions f. That is, when we use B as an oracle, we can reduce 


the complexity of f below what it could have been without the oracle B. 


In this chapter, we try to formalize this idea. We use the word 
"helping" in informal discussions only, and give precise meanings to 
several interpretations. We also give several basic results about the 
existence of sets which help or don't help the computation of certain 


functions. 


Definition 4.1: Assume B is a set, f € Ry and h is a total function of 
two variables. 
"B h-improves f i.o." means: 

(Bi) (V5) tp, ae > oh cr =f > n(x, 3, (x) )< 2 (x) ere el 
"B h-improves f a.e.'' means: 


(B) _ 


Mh 

> 

6 
i 


(21) (Wj), -£ > n(x, G)< 2, (x) ave]. 


We remark that these definitions do not provide us with notions 
of helping that are transitive or symmetric. Appropriate counterexamples 


will be found as corollaries near the end of this chapter. 


An alternative way of measuring the amount of help given by a set 
B to a function f is to ask which lower bounds on the complexity of f 
are maintained after introduction of the B-oracle. To speak about 


(B) 


this kind of "helping" we use the definitions of Comp £ and Comp f, 


etc., introduced as definition 2.6. 
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To place these definitions in some perspective, it is helpful to 


note a relationship between "A op B" and "B h-improves A": 


Assume A is not primitive recursive. Then for any primitive 


recursive function p of one variable, we know that Comp A > p i.o. [C] 


But if A 5 B, then for some primitive recursive function q of 


(B) 


one variable, Comp’ “A S q a.e. Because the primitive recursive 
functions are closed under composition, h° q is primitive recursive 


and therefore Comp A>ho q i.o. 
But since Comp 4 <q a.e., we know that B h-improves A. 


We note that the amount of help a recursive oracle B is able to 
give the computation of a function is restricted by the complexity 
of B. This is because any program using B as an oracle may be converted 
to one not using the B-oracle, by directly computing the answers to 
the oracle queries. The complexity of the new program is bounded as 


follows: 


Theorem 4.2: There exist By» & © Rg with the following property: 
For all B, i, j, if Cc, = 9,5 then there exists k such that: 
is, gat EBD 
a 
and 8, (x) < g,(x,8, (x) ,max (ay. 2) Be. G@). 
: Osysgy (4x58, °° (x)) 
Proof: Although this proof does not exactly fit the statement of 


the combining lemma, we note the essential. similarity of the proofs; 


we call this type of argument a "domain-of-convergence" argument. 
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We use the following general lemma: 


Lemma 4.2.1: Fix any acceptable enumeration of relative algorithms (, ‘ ) 


and any relative complexity measure 3 ), Then: 
a 
(4g € Rg) 


f(AN (0,...,8(i,x,y)} = BM (0,...,8(i,x,y)}) > 


(Vi,x,y) (VA,B) 


(AO m sy @ 2 May sy na @%HD sy 


©, (x) =9,@)))1. 


Proof of lemma 4.2.1: Let ir )) be the standard enumeration of oracle 


Turing machines. 


Axiom (2) for relative complexity measures will allow us to conclude 


() 


the existence of a relative algorithm a such that: 


(Xx) 
1 if $ <y, 
(Vi,x,y,X) a) (<4 x, y>) = i (x) Sy 


O if not. 
Therefore, by lemma 2.2, there exists an oracle Turing machine f ) 
such that: 
7, (<txy) = J1 16 8,9 sy, 


0 if not. 


Now fix i, x and y. Let f be the recursive isomorphism (lemma 


2.2) between the two Godel numberings. 


Define g(i,x,y) = max g'(i,x,y,X), where g'(i,x,y,X) is defined 
XSW 


as follows: 
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g'(i,x,y,X) = , 
the largest number whose membership in X is 
questioned in oracle Turing machine compu- 


tation 7, (<t,x,y>) if 1, (<t,x,y>) = 0, 


the largest number whose membership in X is 


questioned in either computation 


(X) 


3 (<i,x,y>) = Li 


7, (<i,x,9>) or computation T.,,. * (x) fT 


£(i) 


Lemma 2.5.1 shows that g ¢ Ry. 


Now assume that Af) (0,...,g(i,x,y)} = BN {0,...,g8(1,x,y)}. 


Then by definition of g', we have that: 
A B 
7, (<t,xy>) = 1, (<t,x,y>) 


(B) xy), 


(A) re 2 
and (T, (<i,x,y>) = 1) = (Tet) 
But by definition of T, and f£, this implies the lemma. 


Proof of theorem 4.2, continued: We let Bo = the function g from lemma 4.2.1, 


The s-m-n theorem allows us to define a partial recursive function 


Pa(a,b) as follows: 
y if Ga) 9, (x) = y, and (Ww s g,(a,x,8, G0) 
Paca,b) ® * (WEA © O (w) = 1) and 
oe (HA © (Ww) = 0) 
oa otherwise 
By the definition of g in lemma 4.2.1, the function” must 


a(a,b) 


be well-defined. It is easy to see that it is partial recursive. 
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Intuitively, for oracle. Turing machines, 


() 


a(a,b) is simply the 


function computed by ©, » where we use the partial recursive function 


, in place of an oracle. 


We now define g,(x,y,z) = max g'(x,y,2,a,b,A), where: 
a, bSx,ASN 
(A) oy - 
®y(a,b) if e. (x) = y, and 
max {2 (w)} =z, and 
Oswsg,(a,x,y) 


g'(x,y,z,a,b,A) > 
(Ww S g,(a,x,y)) 
(w eA # Dw) = 1) and 
(WEA #9 (w) = 0), 


0 otherwise. 


By the definition of we see that the listed conditions 


a(a,b)’ 
are sufficient to insure the convergeme of Pre p) &*)» and so by 
r 2 


lemma 2.5.1, 8, & Rj. 


We now fix a = j, b= i. 


We claim @(j,i) i< k has the required properties: 


If x = max (i,j), then: 


(B) 
8 (x,%, °° (x) ,max $.(y)) 2 
a “Osysgy(j,x,8,) (xy) * 
es } | 
g'(x,$,° “ (x) ,max $,(y),5,4,B) 
; osysg,(1,x,8, (x) * | 


2 Pa(a,b) since all the listed conditions 


in the definition of g' are satisfied. 


QED 
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Open Question: Can we obtain a version of theorem 4.2 for oracle sets 


B which are nonrecursive? That is, can we find any way to bound the 
amount of help a nonrecursive set B can give to the computation of a 
function (for example, relative to B's Turing-reducibility properties, 


or to B's complexity relative to some set)? 


We next show that for any sufficiently complex recursive set A, 
there exist arbitrarily complex recursive sets B that do help the 


computation of C in fact, which reduce it to triviality. 


A? 


We may further specify that the set B be "compressed" (i.e. 
B's complexity is very closely determined, to within a fixed amount 


h depending on the measure only). 


Theorem 4.3: Let 3 ( ) be any relative complexity measure. There is a 
function h € Ry with the following property: 
Let t be any total, monotone nondecreasing running time. 
Let A be any recursive set such that Comp A S t a.e. 
Then there exists a recursive set B with: 
Comp B > t a.e. 


Comp BS ho t a.e. 


and As B. 
Pp 


(Note: As mentioned in the remark following lemma 2.7, this is an 


example of a theorem which uses an honesty hypothesis.) 
Proof: The proof is a domain-of-convergence argument. 


We carry out the construction in stages, using a Rabin diagonal 


construction with one modification: we introduce new programs into the 
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construction slowly, so most arguments are not needed for the 


diagonalization. We use the remaining arguments to encode A ina 


simple way. The idea is similar to that used by Paterson in 


theorem 4.6. 


We define a function f as follows: 
£(0) = 0, f(n) = LVn) - 1 for all n2 1. 


By the s-m-n theorem, we can define a partial recursive function 


a) (where @ € R,) according to the following construction in 
@(a,b) 2 


stages: 
Stage n: (Define Poa, b) (n)) 


Find the smallest uncancelled i < f(n) such that $, (n) < 2 (n). 


(We diverge if 8, (n)t.) 


If no such i exists, define ? o(a,b) (n) =, (£(n)). 


If i exists, define O04 p) = J] - 9, (n) and cancel i. 
> 


Go on to stage n+ 1. 


END OF CONSTRUCTION 


Now assume we have A, t as in the hypotheses. If we choose a*, 


b* with Lien =tand@,, = Cy and Pax St, then we claim that c, = Paar, b*) 


has the desired properties: 
B is clearly a recursive set. 


As in the proof of theorem 2.8, we can show that Comp B > t 4.e. 


To show A = B, we note the Pi tieine: 

For any n, consider all x with (n + 1)2 Sx< (n+ 2)?, For all such 
x, f(x) =n. There are 2n + 3 such values of x. However, before stage 
(n + 2)?, we only cancel indices < n. Thus, only n+ 1 of the values 
of x may have C, (x) defined by a cancellation. For the remaining 


n+ 2 values of x, we have C, (x) = C,(n). 


Then for any n, (mt2)7=1 


Ly YE) C(x) =n+2,; 
[  eeGaiy 


C,(n) = 
0 otherwise. 


Therefore, A a B. 


It remains to show Comp B Sho t a.e.; to do this, we must first 


define h: 


Let h(x,y) = max _h' (x,y,a,b), where: 


a, bSx 
@ (x) LE (Ww <x) [8 (w) sy A 8 (w) Syl, 
h'(x,y,a,b) = ¢ %(82) . 
0 otherwise. 


The conditions on the right in the definition of h' are sufficient 


to insure that Go9 py (*) +s so that h' € R, and thus h € Ro. 
> 


‘ Now if we fix a = a* and b = b*, we see that for x 2 max(a*,b*), 
h(x, t(x)) 2 h'(x,$, , (x) ,a*, b*) 
= # (ax be) a.e., as required. 
QED 
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Remark: If we do not require the compression of set B, a much simpler 


construction suffices: 


Definition 4.4: For any X, Y, we define X ® Y as follows: 


(Wx) (x €X @®Y) © ((x EXAx FY) V(x EYAxXF x))]. 


Then if we take sufficiently large t' ¢€ Ry relative to t, we can 
obtain C recursive with Comp C > t' a.e., and let B = C join (A @C). 
This set B has two properties: 

As B 


P 
and Comp B > t a.e. 


This second property is easily shown for space measure, using the 
parallel computation property, and recursive relatedness gives the result 


for general measures. 


Results in this chapter have so far been rather intuitive and 
natural; less so are results stating "independence" of sets (for 
example, demonstrating the existence of pairs of recursive sets which 


do not help each other's computation). 


Solutions to problems of this latter type turn out to be analogous 
to work on degrees of unsolvability [Sa] [Rol, 310.2, Chapter 13] in the 


following sense: 


Independence proofs proceed by a diagonalization (the only general 
tool we have thus far for proving such results). The diagonalizations 
require a countable sequence of conditions, or perhaps two different 
countable sequences of conditions, to be satisfied. Satisfaction of 


these various conditions may cause conflict. To insure that each condition 
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gets satisfied, we establish before the construction a "priority 
ordering" of conditions; in our theorems, this is a simple numerical 


ordering. 


We allow the satisfaction of a condition to be interrupted only 
by switching to an attempt to satisfy a higher-priority condition. 
It follows that once we begin trying to satisfy some condition, we must 
thereafter succeed in satisfying either that condition or one of higher 


priority; thus, all conditions will eventually become satisfied. 


Our arguments use priority more complex that the "initial segment" 
priority constructions in ‘Rol, Chapter 13]; we do construct our sets 
by determining values first on initial segments, but we also carry 
with us "tentative commitments" to definition of the set at arguments 
a finite distance beyond the defined initial segment. It is only a 
finite distance beyond, so we are not using the full power of splitting- 


tree arguments, for example. 


Our constructions differ from those in [Sa] and [Rol], however, 
since we are constructing recursive sets. Our constructions are always 
effective, and we insure definition of the functions we construct at 


all arguments. 


After a degree-of-unsolvability priority construction, arguments are 
usually presented showing what oracles are used in the construction, 
and thereby placing the constructed set in its proper Turing degree. 
We are working with a subrecursive analog of these constructions; we 
are generally interested in the complexity of the resulting set. Thus, 


we generally follow our constructions with arguments showing what 
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subcomputations were used in the computation constructing our set, 


thereby placing the constructed set in its proper complexity class. 


We now aim to prove an independence theorem. In order to make 
the proof as compact as possible, we first introduce definitions 
designed to allow us to discuss the independence of the values of a 
0-1 valued function at its different arguments. In theorem 4.6, we 
give an example of a simple theorem using this definition. Lemma 4.7 
shows the existence of a 0-1 valued recursive function whose values 
at its different arguments are independent, while theorem 4.8 shows 
how to split this type of set into two sets which don't help each other's 
computation, thus giving a complexity-theoretic analog to the Friedberg- 


Muchnik theorem /Rol, 710.2]. 


Definition 4.5: Assume A is a recursive set and g is a total function 
of one variable. Then: 
TA 
"Comp Wy > g@ a.e.'' means: 


ax) @, APD a = ea9)1 = @, AOD Gy > goo ae) 1. 


A 
"Comp! ly Sg a.e."" means: 


ay rr¥x) @, O° ay = gan] a @, EHP Gy < G0) ae.) 1. 


The following theorem, due to Paterson [P], shows the abundance 
of O-1 valued functions whose values at different arguments are 


strongly dependent. This settles a question raised by Trachtenbrot /T1]. 


Theorem 4.6: There exist r € Ry> h € Ry with the following property: 
Whenever t is a monotone increasing running time, there exists a 


recursive set A such that: 
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Comp A> t a.e. 
Comp Aho t a.e. 


A] 


[ 
and Comp A Sr a.e. 


Proof: We define the set A, depending on t; we indicate how to 


construct r and h afterwards. 


We define A by a construction in stages. As we do so, we cancel 


indices i such that we know 0, # Cy. 
pa 
Let f(y) = L4l. 


Stage x: (Define Cy (x)) 


See if there exists uncancelled i < f(x) such that rae.) < t(x). 


1. If so, define C, (x) =e Es @, (x). 
Cancel i. 
Go on to stage x + l. 
2. If no such i exists, 
2.1. If Ityly <x and y € A} | is even, we define Cy (x) = 0. 
Go on to stage x + l. 
2.2. Otherwise, define Cy (x) = 1. 
Go on to stage x + 1. 


END OF CONSTRUCTION 


A is clearly recursive. We leave the reader to verify that 


substage 1. insures Comp A> t a.e. 


Verification of the second claim depends on the construction of 


the proper h, which may be done by a domain-of-convergence argument. 
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To verify the third claim, we use the following procedure for 


obtaining C, (x) from Cy on other arguments: 


For all x, B, define: 
0 if there are more arguments y, x+l <= y < 2x for which 
(x = WOetaay - {x}) Nn B| is even than for which 
|({0,...,y} - (x}) N BI] is odd, 


1 otherwise. 


That is, we use the fact that most arguments y with x + 1% y < 2x 


were used not to cancel indices, but to maintain parity. 


From this procedure, it is easy to construct the function r for 
the time or space measure. Recursive relatedness then gives the result 


for general measures. 


QED 
Open Question: Is theorem 4.6 true without the monotonicity restriction? 


Having some familiarity with the way a function's values at differert 
arguments may interrelate, we now go on to produce a set A whose values 
at different arguments are independent. This result in announced by 
Trachtenbrot in [T2]. He gives no proof, however; the proof here is 


due to Meyer. 


Lemma 4.7: (Trachtenbrot): There exists g & Ry with the following 
property: 
For any sufficiently large total running time t, there exists a 


recursive set A with: 
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Comp AS go t a.e., 


A] 


f 
and Comp A> t a.e. 


Proof: We would like to insure: 


1B, FOOD Gy = t60 4.0.) = Ge@, FOP OD #o,00)]. 


As before, we use cancellation; we cancel an index i when we've 
insured that: 


(A~{x) 


(Hx) @, O°) (xy # 6, (x)). 


In addition, at any time during the construction, a single index 
may be "tentatively cancelled."" If an index i is tentatively cancelled, 
it means that we are in the process of attempting to cancel i by 
defining A according to an appropriate "tentative commitment." If we 
succeed in defining A in this way, we will then cancel i; otherwise, 


the tentative cancellation of i will be removed. 


We will use the s-m-n theorem to define a partial recursive 


function » according to a construction in stages. For o. =°t, 


a(a)’? 


the function ) 59) will turn out to be the Cy of our theorem. We use 
the parameter a to allow us later to obtain the desired recursive 


function g by a domain-of-convergence argument. 


We will have stages numbered 0, 1, 2,..., where at stage n, we 
will define ® gy The stages are not executed in consecutive 
order, however. The order in which the stages are executed is deter- 


mined as follows: 


At any time when we are ready to decide which stage is next to be 


executed, the next stage will be stage n if and only if: 
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1. Stage n has not yet been executed, 
2. 9(n)s, 
3. For any m for which stage m is not yet executed, 
om) <2 @), 
and 4. If 9 (n) = $ (mn) for any m for which stage m is not yet 


executed, then n < m. 


(That is, stages are executed in order of size of values of o) 
This trick is similar to that used in theorem 2.8. 


We now describe stage n of the construction: 
Stage = (Define Poa) (n)) 


Find the smallest i < n that is not yet cancelled and such that: 
(a) if some index j is tentatively cancelled, then i < j, and 
(b) there exists E such that: . 
(b1) (¥x| stage x has already been executed){[x €E © Paay &*) = 1], 
(b2) ES {x|x = h(i,n,? (n))}, where h is the function whose existence 
is asserted by lemma 4.2.1, 
(b3) n FE, 
and (b4) 8,“ (n) < 8 (n). 
1. If such an i, E exist, remove any previous tentative cancellation and 
tentative commitment. 
Define 


aay ™) eee 9, cn). 


1.1. If (¥x s h(i,n,®, (n))) [stage x has already been executed], then 


cancel i and go on to the next stage. 
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1.2. Otherwise, tentatively cancel i and make a "tentative com- 
mitment to define 9 so that: 
a(a) 


(fxlx S h(i,n,3.(n)) A x #n) y (x) = C0]. 


ata 


Go on to the next stage. 
2. If no such i exists, 


2.1. If some index j is tentatively cancelled, consider E from its 
tentative commitment. 
Define © 


(ay = C,(n). 


2.1.1. If for a, n arising from j's tentative commitment, 
we have (Vx Ss h(j,n,@,(n))) [stage x has already been 
executed], then remove j's tentative commitment. Change 
j's tentative cancellation to a cancellation. 


Go on to the next stage. 
2.1.2. Otherwise, just go on to the next stage. 


2.2. If no index j is tentatively cancelled, just define (n) = 0. 


a(a) 


Go on to the next stage. 
END OF CONSTRUCTION 


Now assume we have t as in the hypotheses. If we choose a* with 


®.. = t, then we claim that C, = has the desired properties: 


A” Ya(ax) 


A_is a recursive set: 
If we assume that t 2 AxIx], then we may easily show that after 


each stage, the next stage may be chosen effectively. Also, the search 


for E in substage (b) of each stage will terminate. With these facts, 
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the execution of successive stages is an effective process. 


comp!“la > t a.e.: 


We make an important observation about cancellations: 


Fact: If an integer k is tentatively cancelled at some stage, then at 


that stage or later, some integer < k will become cancelled. 
Proof of fact: By induction on k. 
Now for any index i, suppose that (Vx) pp, AOD (xy = C, (x)). 


Then it is not difficult to show that i is never cancelled. 
For if i were cancelled, it means that. at some stage x we set up 4° 
tentative conmitment for i which was eventually fulfilled, so that 
for some x, E as in substage (b), we defined: 


c,(x) #9, (x) 


But by lemma 4.2.1 and the definition of E, we can conclude that: 
E A- 
0 xy =, A) Gwe, 
(A-{x}) 


so that Cy (x) #9, (x). 


Thus,:- i can-never be cancelled. 


There is some stage in the construction such that all cancellations 
of indices smaller than i that will ever occur have already occurred 
by that stage. By the fact above, it follows that at subsequent stages, 
condition (b) must fail to be satisfied for index 4. But then lemma 


4.2.1 implies that 8, @'*}) (x) > e(x) ace. 


Comp AS go t a.e.: 
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We see that (Va,x) p(x) 4 = Poa) 4). 


Thus, by the combining lemma, an appropriate function g exists. 


QED 


Remark: The following related result has been obtained by Meyer using 
similar methods (It has also been announced by Trachtenbrot in [T2], 


but without proof.): 


"For any g € Ros there exists a recursive set A such that: 
¥4) 1%) @ EOD = CO) > CHING, = A 
2(x,8,(x)) < 8°) x) a.e.)) 1." 


In other words, the values of Cy at its different arguments are 
independent in the sense that, for any procedure for Cy which uses 
information about Cy on other arguments, there is a. faster procedure 


for Cy which does not use any such information, 


As a result of lemma 4.7, we now obtain the desired independence 


result: 


Theorem 4.8: There exists h € Ry with the following property: 


For any sufficiently large total running times t, and tos there 
exist recursive sets B and C with: 


Comp Bs ho t, a.e., 


B 


Comp C s ho to a.e., 
Comp ‘© > t a.e., 


and Comp ‘3c > to ace. 


Proof: 
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We use the following lemma: 


Lemma 4.8.1: There exists k ¢ Ry with the following property: 


(V8;) (a8 5) [ s, 2 Fy a.e. and s, sko a, a.e.]. 


(That is, for any measure function, there exists a larger "space 


function" which is not much larger.) 


Proof of lemma 4.8.1: By recursive relatedness, there exists a 


function r relating g 6 ) and 3 ). Without loss of generality, we 
may assume that A<x,y>[r(x,y)] is a space function and r is monotone 


nondecreasing in both variables. 
t 


Assume f is the recursive isomorphism between the Godel numberings 


of the two measures. 


Then r o Sei) is easily shown to be a space function, and if we 
let k = Ax,y[r(x,r(x,y))], then recursive relatedness gives the 


required properties. 


Proof of theorem 4.8, continued: Lemma 4.8.1 shows that if we prove 
the theorem for space measure on oracle Turing machines, recursive 


relatedness will give the general result. 


C), 


It remains to prove the theorem for S 


Definition 4.8.2: If f and g are any functions, we define "f join g@" 
by: (¥x) £ join g (2x) = £(x) 


£ join g (2x +1) = g(x). 


If t. and t, are space functions, then ty join t, may also easily 


C Cc 
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be shown to be a space function. We may apply lemma 4,7 to 
t, join t 


C and obtain a recursive set A with: 


Comp A < g o(t, join to) a.@., 
[A] | | 


and Comp “A > t join te ae, 


We write A= B join C, and claim that B and C have the required 
properties: 


Comp‘ 5 > te a.e.: 


Otherwise, (31) Lo, © = Cy and a, 6° < t, i.o.]. 


But then we can convert 0,‘ ) to a program which. computes Cy 


fast on infinitely many arguments, namely: 


“CaN CH) (0,4 PD (ay = eg) and 


(ax) (8, AD cy < ty join ty (x))]. 


a.e. 


' But this contradicts Comp! Al > t. join t, 


comp ®)¢ > ty a.e.: 
By symmetry. 


Comp B< ho t, a.e., and Comp C sh o t,, a.e.: 


B c 


Define h(x,y) = g(2x,y) + g(2x+l,y), where g is the function 
arising from lemma 4.7. We claim this function h has the required 


properties: 


: Comp A S g o (t, join to) a.e. implies that: 


(Hi) Lo, = C, and S, <8 ° (t, join t,) a.e.]. 


But then 9, may be easily converted to a program for Cc, which 


on argument x, requires space g o (t, join ta) (2x) 
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= g(2x,t, join t,(2x)) 
= g(2x,t,(x)) 
= h(x, t,(x)), as required. 
The other case is symmetric. 


QED 


The earliest independence result in the literature which can be 
stated in terms of existence of two recursive sets not helping each 
other is due to Axt [A2]. Axt states the existence of recursive sets 
A and B such that neither is primitive recursive in the other. His 
proof does not use the complexity formulation of "primitive recursive 
in"; it is an initial segment diagonal éonetuetion similar to theorem 
IV in [Rol, Chapter 13]. With the complexity formulation (theorem 3.2) 


we may obtain Axt's result as a corollary to our theorem 4.8. 


We now use theorem 4.8 to obtain counterexamples to transitivity 


and symmetry of helping. 


Corollary 4.8.3: For sufficiently large functions k, the relations 
"k-improvement a.e." and "k-improvement i.o." are neither transitive 


nor symmetric. 


Proof: We will describe three sets which provide a counterexample to 


all four properties. 


We choose running times t and t. with t, much larger than t 


Cc c* 
By theorem 4.8, we may obtain B, C and h. We then consider the 
three sets B, B join (B ®C), and C. We note the following relation- 


ships between the sets: 
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1. —(B k-improves C i.o.) 
2. —(C k-improves B i.o.) 
3. B k-improves B join (B ®C) a.e. 
4. B join (B ®C) k-improves B a.e. 
5. B join (B @C) k-improves C a.e. 


6. -(C k-improves B join (B ®C) i.o.) 
1. and 2. are clear by theorem 4.8, if k > h. 


3. is true because a B-oracle reduces the complexity of B join (B ®C) 
on even arguments to triviality and on odd arguments to the complexity 
of C. Since te is much larger than t,, this is a large reduction in 


the complexity of B join (B ®C) a.e. To formalize this argument, we 


can use a proof for the space measure and recursive relatedness. 
4. is trivial. 


5. is true since: 


(Vx) IC, (x) =C (2x) @ C (2x + 1)]. 


B join (B © C) B join (B @C) 


6. If C k-improves B join (B ®C) i.o., then either C k-improves 
B join (B ®©C) on infinitely many even arguments or infinitely many 
odd arguments. However, the independence of B and C obtained from 
theorem 4.8 shows that improvement cannot occur on infinitely many 
even arguments. Thus, C k-improves B join (B ®C) on infinitely many 


odd arguments. 


It then follows that C k'-improves (B @C) i.o., for some k' which 


is only slightly smaller than k. We show that this is impossible: 


79 


Consider the space measure. By definition of k'-improvement, 


(C) 


(4i) (Vj), aie and (0, =C 


ac > wee 
k*(x,8, (x) < S,(x) i.o.]]. 


() 


By the parallel-computation property of S > 


aj = < 
( i)l, Cc, Oc and S, ho ty a.e.]. 
Combining the two facts, 
. (C) (C) : 
a = : Ss -0.]. 
(42) Ie, CRpac and ki(x,S,° "(x)) Sho t,(x) io] 


tC) and a program (, for Co with Sy Sho t, a.e., 


We can use °; C 


and thereby obtain a program 9_ (©? = Cc. with k' o is sho t. i.o. 


But for k' sufficiently large, this contradicts the hypothesized 


independence of B and C. 


() 


For general measures © , we obtain the same result if we require 


k to be much larger than the measure-invariance function r obtained 


C). 


by applying theorem 2.5 or remark 2.5.2 to 3 ( ) and § 
The following diagram summarizes our results: 


no k-improvement 


gone pees eg Ma a a.e. 


B B join (B © C) C 


eer Gh as cee aad as pee 


no k-~improvement 


Checking the diagram, we see that we have a counterexample to all 


four properties. 


QED 
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5. Universally-Helped Sets 


In this and the next chapter, we ask if it is possible to improve 
on theorem 4.8. Specifically, theorem 4.8 proves the existence of two 
independent recursive sets by a diagonalization. This leaves open the 
possibility that independent sets are pathological; we would like to 
know if we can obtain a stronger result which allows us to fix one of 


the two sets arbitrarily. 
We are thus led to ask the following (informal) question: 
Which is true? 


(1) There is a recursive set A whose computation is helped by 
all sufficiently complex recursive sets B (a "universally-helped set"), 
or, 

(2) For any recursive set A, there exist arbitrarily complex 


recursive sets B that don't help the computation of A. 


Remark 5.1: We first note that any recursive set will be universally- 
helped in an appropriate measure: Fix any k € Ro» monotone increasing 
in both variables. Let our model for computation be oracle Turing 
machines. Define a measure 3 6 ) as follows: 
c 
g A cx) ie Gy = siy ©-Al, 
6 Aa =9 3 
‘ ko ko re (x) otherwise. 
Now consider a "strongly k-compressed" set A; in other words, 

assume that there exists a total function t with: 


Vi) i = = > ey 
(Vi) O; CA Ss, t a.e.], 


81 
and (Fi) Ip, = Cy AS, S ko t a.e.]. 


We claim that in measure 36 ) A is k-improved by any set B # 9. 


The.reason is as follows: | 


A Ss, Sko t a.e.]. 


We have (di) Ip, = Cy 


Let @,\ ) be the Turing machine that acts exactly like Q, but 


never asks any questions of its oracle. Then: 


(X) _ 
(9K) fp" = Cy 


and as =S,s ko t. a.e.]. 


Consider any set B #¢. Then o = Cy. 


Also, Pica = ram = Ss; a.e. 


‘Thus, Fay Sko t ae. 


However, (V1) 4 = Cy > g ko ko Sy 


> $6 =ko ko t ae.]. 


Therefore, B k-improves A a.e. 


QED 


Pathological measures such as those above show why we will require 


a "simulation overhead function" g in the various theorems of Chapter 6. 


In the remainder of Chapter 5, we work within an arbitrary 
complexity measure and produce a recursive set A whose computation is 
helped by oracles for all sets whose complexity may be compressed - 
between "honest" bounds (bound functions whose running times are closely 


related to their sizes.) We refer back to the remark following lemma 2.7. 
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Further discussion of honesty may be found in [McC] [McCMe] and [MeMo]. 


We note that theorem 4.3 has already given us that every recursive 
set A is helped by arbitrarily complex recursive sets B. These sets B, 
however, were constructed in a very special way, to encode A. In the 
next result, the sets B are not encodings of A, but may be described 


by a restriction (more-or-less) independent of A. 


The function g in theorem 5.2, as well as in the theorems in 
Chapter 6, will depend only on the relative complexity measure 3 ( ) we 
are considering, and will represent a fixed amount of extra resource 
needed to carry out certain simulations. For measures like space, 
we may often think of g as any function which majorizes (is greater 
than) linear functions; for other measures, we may still regard it as 


small relative to the other functions we are considering. 
First, we require a definition: 


Definition 5.2.1: For any h € R, define a recursive set AL as follows: 


2 


Write x = <x >, 


1? 993 
Le 15, (my) EB, Org) < Orgy), 


C, (x) = 
a 0 otherwise. 


An 


(The use of the "="" is only to keep C O-1 valued.) 


Theorem 5.2: (universally-helped set) 


There exists g © R, with the following property: 


2 


For all k, h € R,, k(x,y) 2 y, and all total running times t, 


2? 
any set B with: 


Comp B>goko go ti.o. 
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and Comp Bs ho t a.e. 


k-improves A, L.o. 


Proof: We give three lemmas defining functions Bi» &> and 83 which 
represent extra resource required to combine certain processes in the 
proof. The g in the statement of the theorem will be a combination of 


81> Bo and 3° We use domain-of-convergence arguments. 


Lemma 5.2.2: There exists By € Ry such that whenever 5 is total, 
there exists ®; = a, with: 
By (40, (x)) = 95 (x) ae. 


(Note: This says that running times are honest. See the remark 


following lemma 2.7.) 


Proof of lemma 5.2.2: By the axioms for relative complexity measures 


and the relativized s-m-n theorem, it is easy to see that there exists 
a recursive function a such that: 


(¥4,8, x) 18, (x) = 954) @w I. 


Pali) 


We define 8, (x,y) = max g'(x,y,a), where: 
asx 


6 (x) if y = 3 (x), 
g'(x,ys0) = 4 20) : 
0 otherwise. 


The second lemma gives an upper bound on the. amount of resource 


AL 


Lemma 5.2.3: There exists 8» € R, with the following property: 


needed, with a B-oracle, to compute C 


For any h € Ro» any set B and any total running time t for which: 


(Zi)1@, =C,) A (8, Sho t ae.)], 
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it must be true that: 


(B) _ (B) 
CG) (@, “a A (@, (<i,x,t(x)>) s B, ° t(x) a.e.)]. 


Proof of lemma 5.2.3: We let {F,} be a canonical enumeration of all 


functions defined on a finite domain. That is, we assume that 


AL, x [Fy (x) ] is partial recursive and AL,X[C 4 main 


F (x).] is total 
t. 


recursive. 


Using the relativized s-m-n theorem, we define: 


F(x) if x ¢ domain Fo 
(x) Cy (x») if x ¢ domain F.. and x, = b and 
9 (x) = 
a(a,b,c,d) © (x ) =x 
eh AS Ps d\"2 3? 
9, &) otherwise. 
Now define Bo (x,y) = max &5(x,y,8,b,¢,4), where: 


a,b,c,dsx 


8>(X,y,a,b,c,d) = max g5(x,y,a,b,c,d,X), and: 
XSN 


; (X) ¢ ee 
: (<b,x,9,(x)>) if 3,(x) < 8,(x,y), 
B4(x,y,a,b,c,d,X) = a(a,b,c,d) d a' 1 


0. otherwise. . 
Lemma 2.5.1 is used to show that g, is recursive. 
We now fix a,b,c,d,X as follows: 


‘Let F be a finite function giving values of Ca on all 


arguments of the form <i,x,t(x)> for which 5, (x) >ho t(x). 
Let b = i, the given index for C3: 


Let c = an index for a program for oh 
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Let d be an index for t with the property that % Fic.3) 


S g,(x,t(x)) ave. (by lemma 5.2.2), 


Let X = B. 


It is now easy to verify that Poa bie ae = “a. 
9™“o™9 
Also, if x 2 max(a,b,c,d), then: 


So (x,t(x)) = g5(x,t(x),a,b,c,d,B) 


= Sata,be,d) (bres (™)>) &@.@., 48 required. 


The third lemma provides us with an upper bound for the amount 


of resource needed to convert a program for Ca into a program for C,: 


Lemma 5.2.4: There exists B, & R, having the following property: 


For any h € R,, any set B any total rurming time t, and any i, j, 1 


2 
for which: 
[@, = me) A (3, Sho t a.e.)], 
and ; = C ; 
?; A, 
it must be true that: 


(HL) 1@y = Cy) A By (w) < By (xsmax(sy (x, t(x)),8, (<L,x,t(x)>))) ae.) ]. 


Proof of lemma 5.2.4: We use the s-m-n theorem to define: 


F(x) if x ¢ domainF, 
a a 
Pe(a,b,c,d)°™ = 
rs P , (<b, x9 5 (x) >) otherwise. 
Now define 84 (x,y) = max g'(x,y,a,b,c,d), where 
a,b,c,dsx 
®4(a,b,c,d)™) tf #y(x) < y and £, (<b, x, 4(x)>) § ¥, 


g'(x,y,a,b,c,d) = 


0 otherwise. 
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Clearly, B3 € R,- 


Now fix a, b, c and d as follows: 


Let F be a finite function giving values of Ce on all 


arguments x such that $, (x) >ho t(x). 


Let b = ft. 


Let c j- 


Let d = an index for t with the property that e5 Sgo t a.e, 
(by lemma 5.2.2). 
It is easy to see that Poca,b,e,d) = C,- 


Now if x 2 max(a,b,c,d),. then: 
B(x,max(g, (x, t(x)),%,(<i,x,t(x)>))) 2 
g' (x,max (gy (x5t(x)),%, (<t,x,t(x)>)),a,b,¢,4) 


*(a,b,c,d) a.e.(x), as required. 


Proof of theorem 5.2, contimed: 
We now define g = max (84 +8528) + 
Let 9, = core ay Sho t a.e. 


Then by lemma 5,2.3, 


a1@,© =) A © (<t,x,tG0)>) ign RC ares s 


But lemma 5.2.4 implies: 
MII, = i = (2 Gis, t(x)>) >ko go t (x) i.o.)], 


since otherwise, we obtain a contradiction to the lower bound on B's 
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complexity. 


But this clearly shows that B k~improves AL 1.0. 
QED 


We have thus described an interesting situation: we have sets 
which are helped by all sets whose complexities are compressed between 
honest bounds, and the extent to which they help depends on how 


tightly compressed their complexities are. 


Nevertheless, there are many sets whose complexities are not so 


compressed; sets with speed-up are one example. 


Open Question: Are there recursive sets which are h-compressed, but 
not between honest bounds? Specifically, is it true that: 

For all g, h € Ro» there exist sets A and functions t € Ry such 
that Comp A> t a.e. ae Comp AS go t a.e., but such that for no 
total running time t' is it true that [Comp A> t' a.e. and 


Comp A= hot' a.e.J? 


We can ask similar questions for Comp A >t i.o. and Comp A>t' i.o. 
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6. Sets That Don't Help 


In this chapter, we present ‘two theorems which have the opposite 
intuitive interpretation to the main result of Chapter 5. Both 
theorems begin with a recursive set A and a lower bound on the com- 
plexity of A, lass conclude the existence of ecbereers y. complex sets 


B that "preserve" the lower bound on A's complexity. 


In both theorems in this chapter, a function g is used, representing - 
a minimal amount of helping which the set B is allowed to give to A's 
computation. ‘The Fieeeions g ace necessary because of the existence of 
pathological measures such as thoes given in remark 5.1. As before, 
each function g will depend on the measure only and may therefore be 
considered to be very small compared to the other functions we are 


considering. 
We begin with a definition: 


Definition 6.1: We say that a property holds "for arbitrarily complex | 
recursive sets" if: 


(Vr ¢€ R,) (4B recursive) [Comp B > r a.e. and B has the desired property]. 


In the first theorem, we consider an i.o. lower bound. Intuitively, 


theorem 6.2 makes the following statement: 


"For any recursive set A whose complexity exceeds a known lower 
bound i.o., there exist arbitrarily complex sets B such that the 


complexity of A with a B-oracle still exceeds the lower bound i.o."' 


The method of proof is similar to that used by Machtey [Ma2, theorem 
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4.9] in his proof of the result: 


"Tf f and g are recursive functions with f not primitive recursive, 
then there exists a recursive set C such that f is not primitive 


recursive inc." 


We remark that for the sets B of our construction, it is still 


possible that B may greatly help A i.o. 


Theorem 6.2: There exists g ¢ Ry with the following property: 
For any ty € Ry> and any recursive set A with: 
Comp A > go ty i.0., 
there exist arbitrarily complex recursive sets B with: 


Comp‘® 4 > eae: 


Proof: We obtain g from the following lemma: 


Lemma 6.2.1: There exists g € R, with the following property: 


(A) 


2 


Whenever A is a finite set, r € Ri> and ?, =r a.e@., 
there exists j such that: 
yp, =F (on all arguments), 


and LP S go a) a.e. 
Proof of lemma 6.2.1: Follows from the combining lemma. 


Without loss of generality, we may assume that g is monotone 


increasing in both variables. 


Proof of theorem 6.2, continued: 


We choose t. € Ry arbitrarily. t. will be a lower bound on B's 


complexity. 
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We will define B in stages, with C(x) being defined at stage x. 
During the construction, we cancel indices of programs we know to 
differ from Cpe In the course of the construction, integers a, b and 


c will be defined and changed from stage to stage, where: 


a keeps count of how many conditions of a certain type we have 
so far succeeded in satisfying, 

b (= 7, (a)) indicates which B-oracle program we are currently 
examining, and 

c keeps track of a tentative commitment to an extension of the 


already-defined initial segment of B. 
We let By ={ys xl y € B}. 


We start with a = b = 0, c undefined. (That is, we have not 
yet satisfied any of the conditions we would like to satisfy, we are 
(B) 


examining %o ,» and we have no tentative commitment to an extension 


of the already-defined initial segment of B.) 


Stage x: 


See if there exists i <a such that i is not yet cancelled and 


& (x) < t, (x). 


1. If so, consider the smallest such i. 
Let Cp (x) =1- 9, (*), and cancel i. 
Let c become undefined. 


Go on to stage x + l. 


| 
j=) 


2. If no such i exists, define C,, (x) = 
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See if c is defined. 


2.1. If:so, see if c = x. 


a+i, 


2.1.1. If c = x, redefine a 


b 


7, (a), 
c = undefined, 


and go on to stage x + l. 
(2.1.2. If c # x, just go on to stage x + 1. 


2.2. If c is not defined, see if there exists an argument y such that 
a-< y < x and either 8, Bx (y) > tr(y)s 


or (8x (y) s ty(y) and 8X (y) # CCy)). 


2.2.1. If so, let h be the function whose existence is asserted 


in lemma 4.2.1 and consider h(b,y,t, (y))- 


2.2.1.1. If h(b,y,t, (y)) is S x, then redefine: 
azadl, 
b= 1,(a), 
c = undefined. 


Go on to stage x + l. 


2.2.1.2. If h(b,y,t, (y)) > x, then define c = h(b,y,t, (y)). 


Go on to stage x + 1. 


2.2.2. If no such argument y exists, just retain the values of 
a and b and go on to stage x + 1. 


END OF CONSTRUCTION 
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Verification of the construction: 


The key claim is that the variable a in the construction must 


increase without bound. Suppose it does not. 


This would mean that eventually a would reach a stable value, say 


a Thereafter, neither 2.1.1 nor 2.2.1.1 will be executed. 


0° 
Eventually, we will reach a stage high enough so that 1. can no 


longer be executed (since there are only finitely many i <a). There- 


after, 2. must always be executed. 


Subsequently, if c is ever defined, then there is no way for c to 
become undefined. Thus, we would be forced to execute 2.1 at every 
stage until we are compelled to execute 2.1.1, a contradiction. Thus, 


c is subsequently never defined. 


But this implies that 2.2. must be executed at every stage from 
some point on. However, 2.2.1.1. cannot be executed, and 2.2.1.2. cannot 
be executed since c cannot become defined. Therefore, from some stage on, 


no argument y satisfying the conditions in 2.2. will ever be found. 


But this means that for by = Ty (aq): 


(B,) 


(dx) (Vy = ay) fey, Sie Oy) = S49) A (By Srey) $ t4(9)) 1 


But then lemma 6.2.1 gives a Programe, such that: 


Oo, =C, and °, <got, a.e., 


A 


contradicting the hypotheses of the theorem. 


Thus, we see that a must increase without bound. 
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Comp B > t, a.e.: 


B 


For any index i, if $, s ty i.o., then clause 1. will eventually 


become executed for i, insuring that 2, # C,. 


Comp ‘®)a > t,. i.o.: 


Assume the contrary: 1) 1@, = Cy) A @,® Ss ty a.e.)]. 


Then there exists some least integer a, such that 74 (a) = i and 


0 


(Vy 2 a,) 18,“ «y) < t,(y)]- When a is first set equal to a, at some 


0 
stage, c is undefined, by 2.1.1. or 2.2.1.1. 


Since a grows without bound, it follows that eventually 2.2.1. must 


get executed at some stage x when a = ay: 


But this implies that: 
(y,ay Sy < x)1(8, PX (y) > ty) -V 


(8,2 cy) < ty) A @, Fey) #O,(y))]. 


Moreover, eventually thereafter, either 2.2.1.1. or 2,1.1. must get 
executed, unless prior to their execution, clause 1. is executed. But 
if this happens, then c again becomes undefined so 2.2.1. must again 
get executed. 1. can only intervene finitely many times, since there are 
only finitely many indices less than ao: Thus, we can assume without loss 


of generality that 1. does not intervene. 


But in this case, we insure that: 
(@y = a1, y) > ec) V 18, oy) = yr) A ©, Py #6011, 
0 i A i A i A 
by lemma 4.2.1., which is a contradiction. 


QED 
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Remark 6.2.2: We note that, for the space measure S » the function 
Ax,yfy] will suffice to satisfy lemma 6.2.1 and hence theorem 6.2, 


provided that t, is nontrivial (i.e. t, = Ax!x]). The method for 


A A 


showing this is not the method of the given proof of the lemma, but 
rather a direct proof by analysis of oracle Turing machine space 


measure; information about A and about the finitely-many exceptions to 


tty A) 


i = r' may be stored in the Turing machine's finite control. 


In fact, if we are interested only in the space measure, it is not 


only possible to sharpen our result, but to simplify its proof as well. 


@) 


This is because of the following fact about S » not true for general 


measures: 


Fact 6.2.3: (VA, i, Vt € R, with t 2 Ax[x]) 


L 
If Ta St a.e. and o” is total, then: 


A) 


a1, = a) a 8 s,‘ < t everywhere) ]. 


) 


Fact 6.2.3 implies that for 56 » we need only insure: 


(B) 


(Wi) @y) P= c, = 8, (y) >t], 


rather than: 


(vi) Gy), =c, = 8, cy) > tI. 


This eliminates the need to consider each B-oracle program infinitely 
often during the construction; we need only consider it once. Thus, the 


need for variable b is eliminated. 


Theorem 6.2 provides the following corollary about primitive recursive 


reducibility: 
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Corollary 6.2.4: If A is any recursive set which is not primitive 
recursive, then there exist (in any measure) arbitrarily complex sets B 


such that A¢¥ B and B¢ A. 
P P 
(Recall that means "primitive recursive in.") 


Proof: We show the result for the space measure; clearly, recursive 


relatedness gives the general-measure result. 


Since (Vh)fh is primitive recursive @ h = $], the proof of 
corollary 3.5.2, with each B. = @, shows how to obtain a recursive 
function f such that: 

(Yh) Th is primitive recursive © Comp h S f a.e.]. 


Thus, Comp A > f i.o. 


By theorem 6.2 for ty = f and space measure (where g = Ax,yly], 
as in remark 6.2.2), we obtain arbitrarily complex sets B such that 


Comp 2A > £ i.o. 


We claim that f is greater than or equal to each primitive recursive 
function of one variable, a.e. For if not, then: 

(3h, a primitive recursive function of one variable) [fh > f i.o.]. 
The time and space measures on oracle Turing machines may be shown to 
be recursively related (in the sense of theorem 2.5) by a primitive 
recursive function r. Then the function 2° ° : is clearly primitive 
recursive. However, it requires time = ro h to compute the function 
on all arguments, since it requires that much time just to output the 


answer. Therefore, it requires space = h to compute this function on 


almost all arguments, by recursive relatedness. Therefore, 
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Comp 7a : > £ i.o., a contradiction. Thus, f must be greater than 


or equal to each primitive recursive function of one variable a.e. 


But then Compa > £ i.o. implies that A cannot be computed using 


a B-oracle in primitive recursive space, so A ‘ B by theorem 3.2. 


By making B sufficiently complex, theorem 4.2 shows that we can 
obtain Comp A) g > fi.o. Thus, by theorem 3.2, B # ‘ A. 


QED 


We would like to compare theorem 5.2 with theorem 6.2 to demonstrate 
that there is no conflict between them. We note that theorem 5,2 
produces sets AL which are helped infinitely often by all sets B whose 
complexities are "compressed" around running times. Theorem 6.2 does 
not produce sets B with such a restriction on their complexities. For 
proper comparison, we would therefore like a stronger, ''compressed" 


version of theorem 6.2. 


We may obtain such a strengthened version of the theorem if we are 
willing to allow some additional assumptions: namely, we assume that 
te is a running time, and that t is monotone and much larger than the 


complexity of ty and the complexity of A. 


New Assumptions: (44, 5,k) [ (ty =9,) A (tp = 2) A (Cy = ,) 


A (Wx) [ty (x) 2 max(t,(x-1),9, ),9,(2)) 1] 


The new statement of the theorem is as follows: 


Proposition 6.2.5: 


There exists g € Ry with the following property: 
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Whenever we have tas ty € Ry> A a recursive set, Comp A > go ty i.o., 


and the New Assumptions satisfied, then there exists a recursive set B 


such that: 
Comp B > art a.e., 
Comp B = go te a.e., 
and Comp A >t, i.o. 


Proof: Uses the construction in theorem 6.2, and a domain-of-convergence 


argument to estimate the complexity of B. We omit the details. 


We require one further lemma before making our comparison: 


5c 


Lemma 6.2.6: In any measure ,» there exist arbitrarily large 


monotone increasing running times. 
Proof: Let us fix any t €R 


1° 


We use the recursion theorem [Rol] to define: 


i 0 if x = 0, 
©; (x) = or if (©, - 1)!) and (2, (x) > max(t(x) 9, (x - 1)))] 


© otherwise. 


It is easy to show that Q, must be total and e. has the required 


properties. 
We now note the following: 
Let us use the function g found in proposition 6.2.5. 


Define se € Ry as \x,y!le(x,2(x,y))]. Then we may obtain, by theorem 


5.2, a set a which is i.o. e tnetoved by all recursive sets B whose 
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complexity is weakly g-compressed around a running time. (That is, 


such that Comp B >t, i.o. and 


there exists a total running time t B 


B 


Comp BS go t,, a.e.) 


B 


Now we claim that there exists a recursive function ty which is 


a "good" i.o. lower bound for he complexity, in the sense that Cy 
t 


g 
can be computed a.e. in measure not much greater than tas (This is 


true provided g' is honest, an assumption we may make without loss of 

generality. An examination of the proof of theorem 5.2 shows that: 
A<i,x,y>[g' (x,y) ] 

approximates an i.o. lower bound for the complexity of Anas and that 


Cy can actually be computed a.e. in measure not much greater than 
g' 


this function. ) 


Using lemma 6.2.6. to obtain the appropriate function t,, we 


RB? 
may apply proposition 6.2.5 to the function ty and obtain a set B. 


What is B's relationship to Avy! 


B must ¢7-improve Aas i.o., by theorem 5.2. On the other hand, 


since B preserves the i.o. lower bound t, (at least to within amount g), 


A 


it is impossible that B g-improve a a.e. Intuitively, B g* improves 
Ant i.o. and B fails to e<cinpeave ao i.o. There is, of course, no 


conflict here. 


We note that theorem 6.2 has a real relationship to "improvement" 


only in the case where t, is actually a "good" lower bound for A's 
8 “ 


A 


complexity (i.e. C, can be computed a.e. in measure not much more than 


A 


t In the case of sets A having such "good" lower bounds, theorem 


AD 
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6.2 allows us to conclude (for sufficiently large k) the existence 


of sets B for which it is false that B k-improves A a.e. 


However, not all recursive sets have such "good" i.o. lower 
bounds. For example, sets whose characteristic functions have sufficient 
speed-up cannot have good i.o. lower bounds. For this type of set, 


theorem 6.2 gives us no information about improvement. 


Open Question: Can we obtain a more symmetrical version of theorem 6.2, 
in which A also preserves a lower bound on B's complexity? 

This question may be precisely formulated in several different 
ways. One example is as follows: Is it true that: 


There exists g € R, with the following property: 


2 
Whenever we have ta» tp € Ri> A a recursive set, Comp A > go ty i.o. 


and the New Assumptions satisfied, then there exists a recursive set B 


such that: 
Come OR > th i.o., 
Comp BS go tb a.e., 
and Gomp 7a >t, i.o. 


A 


Open Question: For any recursive set A, we have managed to find sets B 
which preserve any single i.o. lower bound th on A's complexity. Can we 
find, for each A, a single set B which preserves all i.o. lower bounds 


which happen to be total running times)? Further discussion of this 


question will appear in Chapter 7. 


The next theorem, theorem 6.3, is similar to theorem 6.2, but the 


kind of lower bound we are considering is an a.e. lower bound instead 
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of an i.o. lower bound. Theorem 6.3 is almost a companion theorem to 


theorem 6.2; it does require the additional assumptions that ty is a 


running time, and that t, is sufficiently large, however. 


A 


A note on the type of priority construction used for this theorem: 
the proof is a finite-injury priority argument with no apparent recursive 


bound on the number of injuries of each condition. 


Theorem 6.3: There exists g € R, with the following property: 


2 


For any total running time ty such that t, = Xx!x!, and any recursive 


set A with: 
Comp A> go ty a.e@., 
there exist arbitrarily complex recursive sets B with: 


(B) y >t, a4.e. 


Comp A 


We choose a function ty to be an a.e. lower bound on B's complexity. 


Without loss of generality (as we see from lemma 6.2.6 above) we may 


assume that te is a monotone increasing running time. 


We describe a construction which will give us the required set B, 


working from ta» te and A. We use the s-m-n theorem. The parameters 


a, b and c in the construction are to be thought of as follows: 


a will be tas 


eh will be tee 
e. will be Cys 


for a, b, c as above) 


Definition of aa bec) (which will turn out to be CE 


Rabie will be defined in stages, with Pavey? being 
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defined at stage n. 


During the construction, we keep track of two types of cancellation, 
which we call l+cancellation and 2-cancellation. We 1l-cancel an index i 


when we have succeeded in defining Pera b : in such a way that: 
> > 


) 
x,y) (WC) (Co|(0,--059} = Para y cy (Ore) = ©, #0, G0))]. 


These l-cancellations will be used to insure Gomes A > t, ae. 


We 2-cancel an index i when we have insured that 9; # OB (a.b,c)* 


Indices i get 2-cancelled when o. is less thant sufficiently many 


B 


times. This will insure Comp B > ty a.e. 


Once an index is l-cancelled or 2-cancelled, it remains so at all 


later stages. 


Also, at any particular time during the construction, we may have 
some "tentatively l-cancelled" indices. If an index i is tentatively 
l-cancelled, a pair of integers (x, 594) will be defined such that if 
we ever discover that Cy (x; ) # Yy> then i will become l-cancelled. If 
we ever discover that Cy (x,) as then the tentative l-cancellation will 


be removed. 


The same index may become tentatively l-cancelled and lose its 
tentative l-cancellation repeatedly, the values of (X55) changing 
with each tentative l-cancellation, but we will see that: (in the cases 
in which we are interested) may index can only become tentatively 


l-cancelled finitely often. 


Finally, at any time during the construction we may have a 


"tentative commitment for (an index) i". A tentative commitment for 
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i is a quadruple (1,%, 59,525), where Zz. is the canonical index of a 0-1 


valued function Fo with finite domain such that: 
i 


C) 

¥Yoy' i = > ( = 

(¥C) '(C, | domain Fe F,) Oe Ga) ys 

and F_ is an extension of the finite portion of © defined at the 
Z. B(a,b,c) 

time of the tentative commitment to i. The tentative commitment is 


designed to allow us to subsequently tentatively l-cancel i, if possible 


We will eventually fulfill the tentative commitment for i, at 
which time i becomes tentatively l-cancelled, unless we are interrupted 
by the 2-cancellation of an index smaller than (i.e. of higher priority 


than) i, or by a new tentative commitment for an index smaller than i. 


In both the following constructions, we will speak of the "first" 
members of certain collections of finite sets; it is to be understood 


that the ordering we are using is lexicographic. 


At the beginning of Stage 0, there are no l-cancellations, tentative 


l-cancellations, or 2-cancellations, or tentative commitments. 


Stage n: (Define ate b ¢) ™)) 
1. Compute mes) and 2(n ~ 1). 


(If either diverges, then will diverge.) 


B(a,b,c) 
Let X = (x 5 $,(n)|8,(n - 1) < 3,(x) s 3 (n)}. 


See if either of the following, (a) or (b), holds: 
(a) There exist i, x, E such that: 


(al) iS n, iis neither l-cancelled nor tentatively l-cancelled, 


and if there is a tentative commitment for some j, then i < j, 
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(a2) x €X, 


(a3) ES tyly Ss h(i,x,® (x) )} (where h is the function whose 
existence is asserted in lemma 4.2.1), and: 


(Vy Sn-1l)ly €E @& Paa,b,c) = 1), 
and tad) 5 (x) <3 (x). 


(b) There exists i = n, where i is not 2-cancelled, and if there is a 
current tentative commitment for some j, then i < j, and: 


@ (n) s 2 (n). 
1.1. If neither (a) nor (b) holds, 


1.1.1. If there is no current tentative commitment, define 


= 0 and go on to substage 2. 


?a(a,b,c) ™ 


11.2. If there is a tentative commitment (45%, 5¥5 525), let 


© a(a,b,o) \™ = Tae Go on to substage 2. 
1.2. If either (a) or (b) does hold, fix i to be the smallest index 


for which either (a) or (b) is true. 


1.2.1. If i arises from (a), choose the x such that $6 (x) is 
smallest (if two are equal, choose the smaller x), and 
for this x choose the first set E such that (i,x,E) 
satisfy (a). Remove any previous tentative commitment, 
and make a new tentative commitment for i, 
(Gap ws) 
where Z, is the canonical index of the function: 


ee = cal tyly s max(n,h(i,x,?(x)))} ‘ 
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Define ® 5 (5p a) 6™ = re and go on to substage 2. 


1.2.2. If i arises from (b) but not from (a), define: 


Paca,b,c)(™ 1°, 


and 2-cancel i. 


Remove any previous tentative commitment 


and go on to substage 2. 
. See if there is a current tentative commitment (1,%,5Y,52,) such that 


n 2 max (domain F_). 
24 


2.1. If so, tentatively l-cancel i, associating (x5 594) with the 


tentative l-cancellation. 


Remove the tentative commitment and go on to substage 3. 
2.2. If not, then just go on to substage 3. 


. For each tentatively l-cancelled index i with an associated pair of 


integers (%559,)> see if 6 (x,) s $3 (n). 
3.1. If not, ce make no change. 
3.2. If so, then: 
3.2.1. If 9, (%,) = y,» remove i's tentative l-cancellation. 


3.2.2. If 9 (x,) # Ya remove i's tentative l-cancellation and 


l-cancel i. 


Go on to stage n+ 1. 


END OF CONSTRUCTION 


It is easy to verify that if a is total, then for any a, c € N, 
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€ Ry and © is O-1 valued. 


? 8(a,b,c) B(a,b,c) 


Now choose a*, b*¥ and c* such that an = 55 ee a and Pow Os, 


def 
net Ca PB(a*, be 0%)” 


We claim that this set B has the required properties. The key 
step in the proof is the claim that no index gets l-cancelled i.o. If we 


assume this for the moment, the rest of the proof is straightforward: 


It is easy to see that Comp B >t, a.e., as in earlier proofs: if 


B 
@, s ty i.o., then i will be 2-cancelled once all the finitely-many 
higher priority indices which are ever going to be 2-cancelled are so 
cancelled, and once all the (finitely many) tentative l-cancellations of 


higher priority indices have been made. When i is 2-cancelled, clause 


1.2.2. guarantees that ®; # C,- 


We now claim that Comp ‘®) 4 > t, a.e. 


(B) 


For if not, then there is an index i such that ?,; 
MEY br, a 
an t, i.o. 
Such an i could never be l-cancelled during the construction of B, 
for this would mean that for some finite set E and some argument x, 


C, (x) #9, (x) by the l-cancel lation, 


=, (x) by lemma 4.2.1, and clauses 1.2.1. and 521, 


Therefore, each tentative l-cancellation of i will eventually be 


removed by clause 3.2.1. 


We will eventually reach some stage e in the construction of B such 
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that after stage e, no } < i becomes tentatively l-cancelled or 


2-cancelled. Beyond stage e, clauses (a} (b) and 1.2 insure that no 
index smaller than i can prevent a tentative commitment for i from being 
made, nor can an index smaller than i interrupt such a tentative com- 


mitment for i. 


Thus, whenever i satisfies clause (a) at some stage n> e, and i is 
not already tentatively l-cancelled at stage n, i will become tentatively 


l-cancelled at stage n. 


But by lemma 4.2.1, 6 Px) < t, (x) implies the existence of a set E 
such that (i,x,E) satisfies clause (a). Since 5 P(x) s ty (x) i.o., i 
will satisfy clause (a) i.o., and so must become tentatively 1l-cancelled 


Tes OF 
But we have assumed that no index i is tentatively 1l-cencelled i.o. 


Thus, Gong A >t, ae. 


A 


It remains to show that no index can become tentatively l-cancelled 
infinitely often. In order to do this, we construct (by the s-m-n theorem) 


af tion with five parameters, ¢ : 
unction ve p me ; P(a,b,c,d,e) 


The parameters are to be thought of as follows: 


a A? 
6 =t 

b B’ 
es % Cas 


d = the first index which becomes tentatively l-cancelled infinitely 


many times, and 
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e = the number of a stage beyond which no index smaller than d ever 


becomes tentatively l-cancelled or 2-cancelled. We assume e > d. 


Then 9 will represent a program for C, requiring measure 


A 
S go ty (for an appropriate function g). We will let this be the g in 


y(a,b,c,d,e) 


the hypothesis of the theorem, so that we here obtain a contradiction 


to "Comp A>go t, a.e." 


A 


Definition of ) (a,b,c,d e)! 


To Computes (a uscane we proceed as follows: 
t V > t 
If $ (x) or ( n) 1@ (x) ei(n)], nee ai eey A 


Otherwise, let n = pm!® (x) s &(m) 1. 


1. If n< e, let Ove. be3d.6) © = 9 (x). 


2. If n> e, then perform stages 0 through n - 1 in the construction 

of © . At the point immediately after completing stage 
B(a,b,c) 

n- 1, see if either there is a tentative commitment (d,x4,Vq> 24) 


or d is tentatively 1-cancelled. 


2.1. If either condition is true, let Pte b,c,as0) ™ = 9 (x). 


2.2. Otherwise, see if some tentative commitment (d,x',y,z), for 
x # x' would be made at clause 1.2.1. of stage n in the 


construction of ) That is, see if: 


B(a,b,c) 
(Gx! <8 (x) @ (mn - 1) <8 (x') <8 (x) V 
(2 (x) = 2 (x) and x' < x)] A 


rE S (yly 5 h(dx',8,.(x'))}) "(Wy Sn- DC yeE @ 
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ia: & Cf ER) SEG 


2.2.1. If so, let © y &*) = 9 Cx). 


y(a,b,c,d,e 


2.2.2. If not, then see if (JES tyly < h(d,x,®_(x))}) 
(Vy <s = € ’ 
Cy Snes 2)Cy- © Peta biey?? 
E 
4°? GS §,G))1. 
(We are checking to see if at stage n in the con- 


5 : E 
struction of B, a tentative commitment (d,x,0 4 vere 


was made.) 


2.2.27 15-1 E note, £6 © (x) =P .00- 


y(a,b,c,d,e) 

2.2.2.2. If so, consider the first such E and let: 
, 33 CE) 
Vulajbscsdyey a RY 


END OF CONSTRUCTION 


We now assume (as indicated briefly before the construction of 


that a*, b*, c*, d* and e* are fixed as follows: 
Yy(a,b,c,d,e) ec 
6 = 
ax Cas 
$ 
bx te 
Pox = Cys 
d* the first index which becomes tentatively l~cancelled infinitely 
many times duri the construction of 9 ht ae Te. and 
ae BCas, be)” 
e* the number of a stage in the construction of © . ie a, after 
B(a*, b*,c%*) 


which no index smaller than d* ever becomes tentatively 


l-cancelled or 2-cancelled. We assume e* > d*. 


We cream? 4 ; =C 


(a*,b*,c%*,d*,e*) A’ 
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For all clauses except 2.2.2.2., Ota: ee: = eg = CA: 


We must check what happens if clause 2.2.2.2. defines ee (x) 


(E) 


at al at al le 
* b¥,c*,d*, eX) 


If 2.2.2.2. is executed in defining some D(a b*,0%,d*, ex) (> 


x 
3 


then it means that there is a stage n > e* in the construction of 


? eax b,c) at which d*, x and some set E satisfy the conditions in 
b] 3 


1. (a) of that construction. 


d* must be the smallest index for which either (a) or (b) is satisfied 


because we are already past stage e*. 


Thus, in stage n of the construction of Pe tax b¥,c*)? clause 1.2.1. 
bd ’ 


must be executed for i = d*. 
But since clause 2.2.1. of the construction of 


y(a*,b*,c%,d*, ex) *) 


was not executed, it must be the case that no other argument x' could 


interfere with a tentative commitment (d¥, X,Y a9? ) being made at stage 


d se 
Ww 


n in the definition of P a(ax b*,c*)? and so some tentative commitment 
’ > 


(4,2, 4 (®) 244) will be made. 


Eventually, this tentative commitment for d* will cause d* to 
become tentatively l-cancelled, since n > e*. When d* becomes 


tentatively l-cancelled, it will be associated with the pair of integers 


(E) 


(eBay GO): 


Since d* becomes tentatively 1-cancelled infinitely often during 


the construction of ? a(ax b*,c*)? this tentative cancellation must 
» be 0% 


eventually be removed. This can only happen because of clause 3.2.1. 


at some stage m > n in the construction Of acae been but 3.2.1. gets 


“ ws 
> 
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executed only if: 


E 
oc = Pax) = Pyar, be on, dt 4)” 


This establishes the claim that Cy = Pi cax, be,e%,d*,e%)’ 


Next, we would like to show that: 


Ss = 
2 (ak, b*,0%,d*,e*) go ox (= go t,) i.o. 
To do this, we must first define g. 


Let g(x,y) = max g'(x,y,8,b,c,d,e), where we will define 
; a,b,c,d,esx 
g' below. The idea behind the definition of g' is the following: we 


list enough conditions, each recursive assuming the preceding ones are 


satisfied, to insure that ) ) &), and hence @ 


y(a,b,c,4,e) 
converges. On the other hand, we don't put in so many restrictions that 


y(a,b,c,d,e 


we exclude any of the cases we're interested in (i.e. we only list 


properties actually satisfied by a*, b*, c*, d* and e*). 


Here, we basically follow the construction of (x) and 


y(a,b,c,d,e) 


select which of the conditions on a*, b*, c*, d* and e* were needed for 


the convergence of © (ax, b*,c%,d*, ex) (*)> 


We define g'(x,y,a,b,c,d,e) = (x) provided all the 


$ 
y(a,b,c,d,e) 
following conditions are satisfied: 


1. e>d, 
2. y= 8 (x), 


3. 8 (y) = 8 (x), 
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4. Let n = pmt@ (x) < 2 (m)1. Then: 


4.1. n> e, 


4.2. Immediately after performing stage n - 1 in the construction 


of there i o tentativ i t 
? B(a,b,c)? e sn en ive commitment (d,x 


ayar*a)? 
and d is not tentatively 1l~cancelled, 

(Note: This is an effective test since we know that for any 
m <n, ecm) < 2, so that P,(m +. This suffices to 


(m)+.) 


insure that 
° B(a, b,c) 


4.3. There is no x' satisfying clause 2,2. of the construction of 
Pola breve” Precisely, 

(dx! So (x) TT(a cm - 1) < B(x) < O(a) VY (i (e) = OL (x") 

and x' <x)1 A ‘(GE S (z2[z < h(d,x',8,(x"))}) (vz 5 n -1) 


(OE OO gy So CGS 2 TT. 


4.4. (TES {2le < h(d,x, 2. (x))}) 


¥2Sn- eek = 1) 4 6, @ <4, 00)1- 


7 Zz 

Paca,b,c) ‘* 
If one of the conditions fails to be satisfied, we define: 
g'(x,y,a,b,c,d,e) = 0. 


Now by definition, 


g(x? .(x)) = g'(x,? (x) ,a*,b*,c*,d*,e*) ave. 
ax ax 


a t 
Sak Beene es for all x such tha 


a tentative commitment (d*, X,Y aus Z yx) is made at some stage after stage 


e* in the construction of B. 


But since we have assumed that d* gets tentatively l-cancelled 
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infinitely often, this latter equality must occur for infinitely many x. 


go 6 i.o. 


Thus, we have ® oe 


Ss 
y(a*,b*,c*, *,e%*) 


But since © this contradicts the hypothesis: 


be pide te toe. wa SG 
y(a*,b*,c*,d*,e*) A? 
Comp A > go ty a.e. Therefore, our assumption that d* was tentatively 


l-cancelled infinitely often was wrong, and so we conclude that no 


index gets tentatively l-cancelled infinitely often in the construction 


” B(ax,b*,c%* QED 


Remark: Part of the difficulty of the preceding proof arises from the 
fact that there is no evident effective way to estimate how many 

tentative commitments for an index may be removed. The resemblance to 
finite injury priority arguments without recursive bounds on the number 


of injuries is readily apparent. 


We now wish to discuss the relationship between theorems 6.3 and 
5.2. As in the parallel discussion for theorem 6.2, we require a 


"compressed" version of the theorem: 
We obtain: 


Proposition 6.3.3: There exists g © Ry with the following property: 


Whenever we have total running times ty and te with ty monotone 


increasing, and a recursive set A with Comp A> go t, a.e., and if 


A 
ty = dx!x!, then there exists a recursive set B such that: 
Comp B > t, ae. 


Comp B = go tp a.e., 


and Came PA > t, a.e. 


113 


Proof: It is easy to verify that (Vx,a,b,c)!x € domain 95/4 bees 


whenever {0,1,...,x} [| domain eel 


Thus, by a simple domain-of-convergence argument, we may find a 
function g! € Ry such that: 


$ < g! co) .e. 
B(asbeey. SS Bee 
whenever e is monotone increasing, and the proposition follows 
immediately from theorem 6.3. 
QED 


Having this stronger version of theorem 6.3, we may now note the 


following: 
Let us use the function g found in proposition 6.3.3. 


As before, define = € Ry to be Ax,y!e(x,g(x,y)]. Then we obtain, 
by theorem 5.2, a set Begs which is i.o. oc oimnveved by all recursive 
sets B whose complexity is weakly g-compressed around a running time. 


(That is, there exists a total running time t, such that Comp B > tp 1.0. 


B 


and Comp B = go t,, a.e.) 


B 


Now assume that there exists a recursive function t, which is a 


A 
"good" a.e. lower bound for Bawhe complexity, in the sense that Cy 
g! 
can actually be computed a.e. in measure not much greater than th: 


If such a function t, exists, we may apply proposition 6.3.3. to 
t, and an appropriate t, and obtain a set B. What is B's relationship to 


A_,? 
g! 


B must e"-tuprove By i.o., by theorem 5.2. On the other hand, 


since B preserves the a.e. lower bound t, (at least to within amount g), 
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it is impossible that B e dnprove Dei Ee But this is a contradic- 


tion. 


Hence, we see that the assumed existence of the "good" a.e. lower 
bound was false, so Aas can have no "300d" a.e. lower bound on its 


complexity. 


Open Question: Can we obtain a more symmetrical version of theorem 
6.3, in which A also preserves a lower bound on B's complexity? (This 
is stronger than theorem 4.8 because the set A may be fixed arbitrarily.) 
One way of formulating this is the following: 
Is this true: 

"There exists g € Ry with the following property: 

Whenever we have total running times th and t with t, monotone 
increasing, and a recursive set A with Comp A > go t, ae., then there 
exists a recursive set B with: 

| Comp“) g > t, a-e. 


Comp B = go t, a.e. 


B 
and Comp™) a > ty ace." 2? 


Open ouaution: For any recursive set A, we have found sets B which 
preserve any single a.e. lower bound t, on A's complexity, provided ty 
is a running time. Can we find, for each A, a single set B which 
preserves all running time a.e. lower bounds? Further discussion of 


this question will appear in Chapter 7. 


Open Question: In theorem 6.3, can the hypothesis that ty is a running 


time be, eliminated? 
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7. Suggestions for Further Study: 


In this chapter, we collect open problems from Chapters 3-6 and 


make further suggestions for additional work. 


7.1. In theorem 6.3, can the "running time" hypothesis on t, be eli- 


A 

minated? That is, can we prove the following theorem: 
"There exists g € Ro with the following property: 
For any ty € Ry (with t, = d\x!x]), and any recursive set A 


with Comp A>go t, a.e., 


A 
there exist arbitrarily complex recursive sets B such that: 


Comp ©) 4 7 t, Be." 72 


A 


7.2. Can we strengthen theorem 5.2 to omit or weaken the complexity 
restrictions on B? 
For example, can we prove: 


"For all k € R there exist sets A and functions t € Ry such 


2°? 
that: 


(VB) [Comp B>ra.e. * B k-improves A i.o.1" ? 


There are other possible formulations of the same (intuitive) 


question. 


7.3. Part of the intention of introducing the notion of "helping" was 
to give a formal interpretation of the way in which a subroutine 
helps the computation of a function. (The oracle set plays the 
role of a subroutine). Intuitively, it appears that a definition 
of "helping" which accurately reflects this situation should be 


transitive, contrary to corollary 4.8.5. We see that the difficulty 


7.4. 
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arises because the "helping sets'' we consider in the counterexample 
are in fact unlike subroutines because they encode the entire function 
whose computation they are supposed to help (i.e., we say B join 


(B ©C) helps the computation of C). 


We would like some way of eliminating this difficulty. Can 
we make some suitable restriction on the kinds of sets allowed as 
oracles (e.g. restrict their complexity relative to that of the 
function being helped) to make our notion of helping a transitive 


one? 


If we intend, as above, to give a formal interpretation of 
the way in which a subroutine helps the computation of a function, 
then we should not restrict our attention to set oracles, but 
rather we should have a model for computation which allows help 


from arbitrary partial recursive functions. 


Some work in this direction has already been done by Symes in 
his thesis ‘Sy’. Symes has defined an acceptable ordering of 
"subroutine operators" which work not in conjunction with an 
arbitrary set oracle (as do relative algorithms), but rather in 
conjunction with a partial recursive function. Complexity axioms 


in the style of Blum are then developed for these operators. 


Consideration of the kind of complexity restrictions needed on B in 
theorem 5.2, and elsewhere in the thesis, leads us to inquire about 
the relationships between the different types of complexity 


restrictions. 


7. 


7. 


5. 


117 


For example, we ask which of the following statements are true: 


tacks Cig 2 R,) Wh € Ry) (GA,Et € Ry) 
Comp A> t a.e. and CompA*S go t a.e., 
but such that for no total running time t' is it true that: 


Comp A> t' a.e, and Comp A Sho t! a.e. 


("A is strongly compressed but not between honest bounds."') 


Titel Cige-§ Ry) (Wh € Ry) (4A, at € Ry) 
Comp A> t i.o. and Comp A Sgo t a.e., 
but such that for no total running time t' is it true that: 


Comp A> t' i.o. and Comp A Sho t! a.e. 


("A is weakly compressed but not between honest bounds.") 


Can we obtain a version of theorem 4.2 for oracle sets B which are 
nonrecursive? That is, can we find any way to bound the amount of 
help a nonrecursive set B can give the computation of a function (for 
example, relative to B's Turing-reducibility properties, or to B's 


complexity relative to some oracle set)? 


For any recursive set A, theorem 6.2 gives sets B which preserve any 
single i.o. lower bound t, on A's complexity. Can we find, for each 
A, a single recursive set B which preserves all i.o. lower bounds 
on A's complexity (or, more restrictively, all i.o. lower bounds 


which happen to be running times)? This would imply that B failed 


to help A, in a somewhat more natural sense than theorem 6.2. 


For example, it might be possible to somehow take into account 


all i.o. lower bounds on A's complexity, and hence construct B by 
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working from all the i.o. lower bounds rather than a single one. 


For any recursive set A, we have found sets B which preserve any 
single running time a.e. lower bound on A's complexity. Can we 
find, for each A, a single set B which preserves all a.e. lower 


bounds, (or all running time a.e. lower bounds)? 


A serious drawback to the idea of taking into account all a.e. 


lower bounds on A's complexity is the following claim of Meyer ‘Mel: 


"There exists a recursive set A such that no sequence of 
total functions {p,} satisfies the following properties: 

(a) Ai,x'p, (x) ] is recursive, 

(b) (Vi) 'Comp A > P; a.e, | 


(c) (Vr € R,)'(Comp A>ra.e.) > C4), > r a.e.)1" 


Dp 


We do not know whether a similar result holds for i.o. lower bounds. 


In Chapter 6, the sets B which don't help A, fail to help it in that 
they preserve a given lower bound on A's complexity. It would be nice 
to be able to sharpen theorems 6.2 and 6.3 to involve k-improvement, 
by applying them to a single "best possible'' lower bound on A's 


complexity. 


Unfortunately, Blum's speed-up theorem [Bl] tells us that for 
some recursive functions, no lower bound is close enough to the 
actual running time of a program for that function to insure that 
the resulting set B does not k-improve A. That is, some recursive 
functions do not have their complexities well-described by a single 


lower bound function. 
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However, it can be shown ‘MeF!] that the complexity of any recursive 
function may be described by a sequence of recursive functions 
{P;} called a "complexity sequence," having some nice properties: 
(a) Ai,x'p, (x)! is recursive, 
(b) Each Py is a total running time, 


(c) (Yi) ho P; 7 P a.e.] (for some h depending on the 


itl 
measure only). 
Using the concept of a "complexity sequence,'' Meyer has 


obtained a version of theorem 4.8 in which neither of the sets B 


or C k-improves the other for any nontrivial k. 


In the hope that this method will extend to other problems 


(notably the questions in Chapter 6), it would be nice to better 


understand how the complexity of recursive functions can be character- 


ized in terms of complexity sequences. 
For example, two specific questions: 


7.8.1. Does every recursive function f have a 0-1 valued recursive 
function g with "approximately" the same complexity sequence? 
This means that there exists a function h © Ro depending on 
the measure only, for which: 
(a (f,}, a complexity sequence for f), and 


(a (s,}; a complexity sequence for g) 


VE, 85) (h oct zB, a.e.) A (¥g,) GE.) (h ee i Pe te ih 


7.8.2. Give necessary and sufficient conditions on a sequence of 


functions that it be a complexity sequence. 


7.9. 


7.10. 


120 
For example, in 'L], we have two sets of sufficient condi- 
tions, where each set of conditions includes a synchroni- 
zation condition (i.e. infinitely many of the functions in 
the sequence are large and small at the same arguments). 
However, we can show that synchronization conditions are 
not necessary in the following strong sense: we can obtain 
functions f with effective i.o. speed-up 'B2] such that no 


complexity sequence for f can be synchronized. 


Many other questions about helping besides those in Chapters 4-6 
may be asked, some of which are probably answerable by methods 
similar to those used in Chapters 4-6. There are different for- 


malizations of the same intuitive questions, but some examples are: 


7.9.1. Does there exist a "universally-helping set"? 
Specifically, is it true that: 
(Yh € Ro) A, a recursive set)(Vt, total running times) (VB) 


‘(Comp B > t a.e. and Comp B S ho t a.e.) > (A h-improves B)] ? 


7.9.2. Can a set always be helped in a "controlled" way? 
Specifically, is it true that: 
(Yh € Ro) total running times t, t' with t > t')(4 recursive 
sets A,B) 
(B), > ¢r 
‘(Comp A> t a.e.) 4 (Comp AS ho t a.e.) A (Comps “A> t' a.e.) 


A (Gong Ok yo St Bee 2 


Is theorem 4.6 true without the monotonicity restriction? Namely, 
is it true that: 


"There exist r © Ry> h € Ry with the following property: 


Takk 


7.12. 


Piro i 
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Whenever t is a running time, there exists a recursive set 


A with: 

Comp A> t a.e., 

Comp A Sho t a.e., 
and Coup A Sra.e." ? 


Can we obtain more symmetrical versions of theorems 6.2 and 6.3, 


in which A also preserves a lower bound on B's complexity? 


One example of a precise formulation of this question for 
theorem 6.2 is the following: Is it true that: 
"There exists g € Ry with the following property: 


Whenever we have t ty € Ry» A a recursive set, Comp A 


A? 
> go ty i.o., there exists a recursive set B such that: 
ous B > t, i.o. 
Comp B S go t, ae. 
and Comp ‘®) a > ty i.o." ? 


This thesis deals almost exclusively with results about functions 
in R and oe It would be interesting to consider similar 


(A) 


results in Ee and P For example, questions 7.4 and 7.8 may 


be rephrased for partial functions. 


We may use Symes' definitions /Sy] for programs with partial 
recursive functions in place of oracles, and reformulate our 


questions about helping in these terms. 


Is is possible to strengthen proposition 3.14 in the following way: 


"Given any nonrecursive set A, it is always possible to find a 


7.14. 


7.15. 
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set B such that: 


A|B and A-reducibility = B-reducibility!' ? 
T 


Is bounded truth-table reducibility, or any of the other redu- 
cibilities mentioned by Jockusch in his thesis !J1] complexity~ 


determined? 


In his thesis, Jockusch develops the properties of various types 
of truth-table reducibilities, such as containment properties of 
degrees. Explore the answers to these questions for C-reducibili- 
ties for various sets C. For example, does C-reducibility have 


any properties significantly different from truth-table reducibility? 
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